-- Logs begin at Mon 2022-05-02 08:06:41 UTC, end at Mon 2022-05-02 09:14:14 UTC. -- May 02 08:42:48.584188 dv-osbrick-master-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... May 02 08:42:48.591777 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 02 08:42:48.595029 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 2 08:42:48 2022] *** May 02 08:42:48.595029 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 02 08:42:48.595029 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 02 08:42:48.595029 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: nodename: dv-osbrick-master-4-ceph May 02 08:42:48.595029 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: machine: x86_64 May 02 08:42:48.595029 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: clock source: unix May 02 08:42:48.595029 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: pcre jit disabled May 02 08:42:48.595029 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: detected number of CPU cores: 4 May 02 08:42:48.595029 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: current working directory: / May 02 08:42:48.595029 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: detected binary path: /usr/bin/uwsgi-core May 02 08:42:48.595029 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: your processes number limit is 47680 May 02 08:42:48.595029 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: your memory page size is 4096 bytes May 02 08:42:48.595711 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: detected max file descriptor number: 2048 May 02 08:42:48.595711 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: lock engine: pthread robust mutexes May 02 08:42:48.595711 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: thunder lock: enabled May 02 08:42:48.595711 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 02 08:42:48.595711 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 02 08:42:48.645598 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: Python main interpreter initialized at 0x5567c2f2f9c0 May 02 08:42:48.645598 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: python threads support enabled May 02 08:42:48.645598 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: your server socket listen backlog is limited to 100 connections May 02 08:42:48.645598 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: your mercy for graceful operations on workers is 90 seconds May 02 08:42:48.645988 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: mapped 403077 bytes (393 KB) for 2 cores May 02 08:42:48.646065 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: *** Operational MODE: preforking *** May 02 08:42:48.646286 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: *** uWSGI is running in multiple interpreter mode *** May 02 08:42:48.646286 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: spawned uWSGI master process (pid: 93327) May 02 08:42:48.646493 dv-osbrick-master-4-ceph systemd[1]: Started Devstack devstack@keystone.service. May 02 08:42:48.647078 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: spawned uWSGI worker 1 (pid: 93340, cores: 1) May 02 08:42:48.647420 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: spawned uWSGI worker 2 (pid: 93341, cores: 1) May 02 08:42:48.647887 dv-osbrick-master-4-ceph devstack@keystone.service[93327]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 02 08:42:54.393499 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 02 08:42:54.393499 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: from cryptography.utils import int_from_bytes May 02 08:42:54.394305 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 02 08:42:54.394305 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: from cryptography.utils import int_from_bytes May 02 08:42:54.394718 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 02 08:42:54.394718 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: from cryptography.utils import int_from_bytes May 02 08:42:54.394838 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 02 08:42:54.394838 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: from cryptography.utils import int_from_bytes May 02 08:42:54.447105 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 02 08:42:54.447292 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 02 08:42:54.447379 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 02 08:42:54.447474 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] command line args: [] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 02 08:42:54.447560 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 02 08:42:54.447722 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 02 08:42:54.447813 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] command line args: [] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 02 08:42:54.447889 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ================================================================================ {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 02 08:42:54.447999 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 02 08:42:54.448156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] admin_token = **** {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.448253 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ================================================================================ {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 02 08:42:54.448399 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] config_dir = [] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.448488 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] admin_token = **** {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.448569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.448677 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] config_dir = [] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.448766 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] config_source = [] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.448853 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.448929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] debug = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.449034 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] config_source = [] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.449388 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.449627 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] debug = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.449745 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.449878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.449878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.450076 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.450076 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.450276 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.450381 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.450487 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.450588 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.450687 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] list_limit = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.450784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] log_config_append = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.450892 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] list_limit = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.451002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.451107 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] log_config_append = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.451212 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] log_dir = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.451318 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.451430 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] log_file = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.451546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] log_dir = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.451546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] log_file = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.451757 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.451841 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.451955 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.452074 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.452213 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.452293 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.452414 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.452541 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.452627 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.452868 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.453114 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.453345 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.453576 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.453804 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.454034 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.454278 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.455066 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.455340 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.455829 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.456007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] publish_errors = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.456261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.456522 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.456666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.456757 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.456868 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.456959 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.457076 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.457222 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.457369 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.457483 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] standard_threads = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.457639 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.457760 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.457874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.457956 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.458029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.458137 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.458223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] use_journal = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.458346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.458494 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] use_json = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.458494 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] use_stderr = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.458720 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.458864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] use_syslog = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.459064 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.459215 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.459340 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.459464 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.459592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.459736 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.459736 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.460006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.460149 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.460282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] publish_errors = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.460402 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.460557 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.460680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.460797 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.460926 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.461045 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.461163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.461280 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.461404 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.461522 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.461647 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.461765 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] standard_threads = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.461882 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.462006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.462123 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.462241 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.462369 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.462495 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.462495 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] use_journal = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.462728 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.462852 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] use_json = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.462976 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.463106 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] use_stderr = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.463106 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] use_syslog = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.463368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.463487 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 08:42:54.463603 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.463720 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.463846 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.463971 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.464108 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.464228 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.464346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.464473 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.464679 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.464808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.464933 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.465057 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.465175 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.465283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.465411 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.465529 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.465646 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.465763 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.465886 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.466010 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.466137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.466255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.466379 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.466504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.466621 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.466738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.466863 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.466982 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.467098 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.467215 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.467337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.467471 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.467674 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.467796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.467921 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.468057 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.468188 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.468188 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.468500 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.468630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.468749 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.468872 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.468990 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.469107 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.469237 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.469360 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.469477 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.469594 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.469711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.469835 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.469954 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.470099 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.470280 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.470465 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.470657 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.470873 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.471065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.471196 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.471317 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.471441 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.471560 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.471688 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.471814 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.471932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.472086 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.472209 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.472327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.472458 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.472578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.472698 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.472816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.472934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.473052 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.473178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.473298 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.473428 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.473554 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.473674 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.473793 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.473911 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.474038 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.474157 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.474276 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.474402 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.474521 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.474639 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.474766 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.474886 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.475004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.475122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.475246 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.475372 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.475372 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.475621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.475748 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.475868 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.475986 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.476121 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.476241 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.476373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.476493 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.476611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.476728 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.476855 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.476986 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.477106 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.477224 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.477348 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.477467 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.477585 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.477781 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.477904 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.478022 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.478140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.478263 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.478383 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.478510 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.478629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.478759 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.478885 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.479004 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.479129 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.479256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.479381 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.479500 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.479618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.479736 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.479854 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.479983 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.480185 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.480307 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.480425 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.480543 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.480661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.480787 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.480919 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.481052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.481172 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.481289 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.481408 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.481526 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.481645 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.481774 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.481894 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.482019 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.482139 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.482257 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.482375 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.482502 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.482628 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.482747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.482865 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.482983 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.483108 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.483235 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.483355 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.483473 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.483592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.483710 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.483828 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.483954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.484091 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.484214 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.484333 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.484451 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.484569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.484700 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.484820 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.484938 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.485056 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.485174 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.485293 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.485419 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.485540 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.485669 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] auth.external = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.485861 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.486031 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.486221 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.486438 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.486599 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.486721 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.486829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.486955 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] auth.password = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.487084 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.487204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] auth.token = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.487325 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.487443 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.487561 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.487686 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.487814 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.487934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.488100 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.488223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.488342 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.488342 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.488586 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.488708 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.488857 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.488990 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.489111 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.489111 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] credential.caching = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.489338 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.489338 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.489562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.489562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.489796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.489916 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.490034 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.490153 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.490283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.490404 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.490524 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] auth.external = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.490643 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.490762 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.490881 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.491008 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.491130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.491249 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.491368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.491487 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] auth.password = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.491606 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.491797 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] auth.token = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.491797 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.492024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.492162 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.492281 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.492400 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.492532 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.492660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.492780 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.492898 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.493017 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.493136 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.493266 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] federation.caching = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.493386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.493505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.493624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] credential.caching = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.493743 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.493861 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.493988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.494114 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.494234 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.494353 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.494471 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.494590 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.494717 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.494838 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.494957 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.495075 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.495200 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.495326 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.495454 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.495574 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.495694 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.495813 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.495932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.496086 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.496222 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] identity.caching = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.496343 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.496462 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.496581 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.496699 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.496819 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.496946 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.496946 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.497181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.497300 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.497419 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.497538 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.497665 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] federation.caching = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.497786 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.497906 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.498024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.498143 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.498262 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.498390 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.498511 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.498629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.498748 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.498868 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.498994 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.499123 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.499247 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.499368 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.499487 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.499606 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.499733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.499853 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.499973 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.500107 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.500229 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.500348 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.500348 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] identity.caching = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.500585 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.500585 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.500808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.500934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.501054 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.501181 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.501852 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.502027 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.502213 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.502405 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.502601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.502762 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.502885 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.503005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.503126 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.503246 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.503365 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.503493 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.503614 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.503733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.503853 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.503972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.504134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.504270 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.504392 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.504511 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.504630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.504749 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.504868 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.504995 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.505116 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.505235 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.505354 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.505473 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.505592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.505720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.505841 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.505960 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.506088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.506209 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.506329 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.506457 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.506577 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.506703 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.506824 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.506943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.507062 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.507190 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.507312 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.507312 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.507543 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.507663 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.507782 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.507909 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.508030 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.508166 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.508287 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.508406 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.508525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.508657 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.508779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.508898 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.509017 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.509135 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.509260 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.509394 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.509514 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.509634 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.509757 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.509877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.509996 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.510124 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.510244 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.510363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.510481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.510600 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.510719 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.510846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.511048 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.511173 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.511292 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.511412 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.511531 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.511664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.511785 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.511904 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.512022 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.512206 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.512336 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.512457 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.512577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.512696 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.512815 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.512933 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.513065 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.513186 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.513305 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.513423 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.513543 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.513662 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.513789 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.513910 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.514028 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.514148 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.514266 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.514385 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.514512 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.514634 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.514753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.514871 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.514991 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.515110 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.515237 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.515358 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.515477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.515595 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.515715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.515834 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.516029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.516171 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.516291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.516410 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.516529 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.516707 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.516844 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.517620 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.517821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.518024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.518177 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.518298 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.518429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.518550 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.518669 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.518789 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.518907 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.519026 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.519154 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.519264 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.519383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.519502 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.519622 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] resource.caching = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.519740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.519873 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.519994 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.520139 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.520260 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.520379 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.520498 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.520630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.520752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.520872 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.520990 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.521109 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.521228 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.521355 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.521475 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.521602 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.521722 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.521841 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.521961 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.522089 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] role.caching = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.522210 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.522329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] role.driver = sql {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.522447 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.522566 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.522685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.522857 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.522983 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.523103 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.523222 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.523340 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.523459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.523586 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.523707 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.523825 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.523944 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] resource.caching = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.524094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.524218 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.524349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.524471 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.524590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.524708 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.524827 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.524946 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.524946 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.525180 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.525299 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.525418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.525537 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.525656 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.525784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.525904 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.526023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.526023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] role.caching = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.526246 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.526374 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] role.driver = sql {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.526494 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.526613 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.526731 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.526850 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.526969 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.527096 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.527217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.527335 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.527454 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.527573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.527698 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.527826 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.527946 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.528083 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.528206 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.528325 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.528444 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.528585 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.528710 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.528829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.528948 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.529068 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.529186 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.529315 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.529436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.529561 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.529681 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.529800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.529930 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.529930 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.530165 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.530284 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.530403 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.530522 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.530647 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.530776 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] token.caching = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.530897 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.531016 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.531134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.531252 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.531378 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.531506 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.531626 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.531745 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.531863 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.531982 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.532189 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.532313 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.532433 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.532598 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.532777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.532964 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.533168 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.533369 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.533531 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.533655 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.533774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.533894 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.534023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.534143 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.534263 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.534382 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.534503 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.534621 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.534749 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.534870 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.534990 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.535109 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.535228 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] token.caching = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.535347 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.535475 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.535596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.connection = **** {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.535725 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.535854 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.535975 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.536136 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.536258 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.536389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.536519 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.536641 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.536767 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.536888 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.537007 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.537125 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.537253 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.537374 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.537493 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.537612 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.537731 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.537850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.537978 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.538099 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.538217 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.538378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.538536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.538676 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.538876 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.539000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.539121 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.539240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.539359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.539478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.539607 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.539728 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.539852 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.connection = **** {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.539986 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.540137 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.540261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.540261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 02 08:42:54.540495 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.540495 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.540495 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.540495 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.540495 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.540495 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.540495 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.540495 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.540495 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.541504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.541504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.541504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.541504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.541504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.541504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.541504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.541504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 08:42:54.541504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 02 08:42:54.563318 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.563546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.563774 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.567258 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.567485 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.567714 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.573121 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.576371 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.601500 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.601727 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.603176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.603404 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.654732 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.655194 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.706950 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.707217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.707668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.707902 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.780263 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.780531 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.780646 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.780732 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.780812 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.780921 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.781010 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.781134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.781221 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.781346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.781432 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.781555 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.808331 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.808563 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.808792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.809018 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.809236 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.809478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.809690 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.810293 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.810525 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.810745 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.810988 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.811174 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.811386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.811598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.822626 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.823828 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.836187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.836421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.836591 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.836693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.836823 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.836943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.837049 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.837131 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.837239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.837327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.837446 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.837542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.837653 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.837860 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 08:42:54.854670 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.854879 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 02 08:42:54.854981 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.855153 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 02 08:42:54.855236 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.855400 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 02 08:42:54.855650 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.855733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.855851 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 02 08:42:54.855937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.856148 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.856235 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.856406 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.856503 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.856658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.856904 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.867876 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.868188 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.868452 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.868551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.868731 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.868817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.869059 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.869335 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.877076 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=93341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.877709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=93340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.880352 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=93341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.880628 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.880905 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.881058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=93340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.881182 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.881331 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.881459 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.881608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.881713 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.881885 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.881969 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.882161 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.882244 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.882419 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.882509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.882681 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.882764 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.882947 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.883030 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.883215 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.883480 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.883742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.909663 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.910625 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.911206 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.911477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.912251 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.912526 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.916724 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=93341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.916999 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.917392 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.917766 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=93340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.918039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.918315 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.925300 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=93341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.925578 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.926211 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=93340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.926485 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.930009 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.930292 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.930571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.930851 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.930937 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.931121 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.931206 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.931393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.931487 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.931655 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.931740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.931919 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.932004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.932244 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.932509 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.932771 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.950802 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.951073 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.951632 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.951910 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.955787 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.956528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.959439 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.959729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.960137 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.960427 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.964829 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.965507 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.968439 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.969125 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.972714 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.973006 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.973290 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.973415 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.973575 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.973706 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.973850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.973981 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.974127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.974270 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.974613 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.974899 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.993731 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.994009 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.994275 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.994537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.994792 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:54.995085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.995349 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:54.995614 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.002619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.003713 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.004364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.004638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.005462 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.005732 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.007818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=93341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:55.008117 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.008398 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.008689 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.008931 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=93340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:55.009018 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.009219 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.009509 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.009803 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.010078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.022135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=93341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:55.022412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.022687 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.022966 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.023241 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.023569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=93340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:55.023656 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.023845 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.023931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.024149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.024426 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.024698 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.024971 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.025244 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.042146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=93341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:55.043670 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=93340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:55.045402 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:55.046935 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:55.048766 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.050428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.050530 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.052133 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.052223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=93341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:55.052416 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.052695 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.053897 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=93340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:55.054173 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.054452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.059944 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.061572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=93341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:55.061677 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.063260 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=93340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:55.065577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.065858 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.067013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.067226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.067311 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.067511 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.067598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.067830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.076865 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:55.077145 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.077420 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.078185 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:55.078465 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.078746 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.085376 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=93341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:55.085651 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.085924 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.086199 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.086470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.086704 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=93340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 08:42:55.086849 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.086994 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.087121 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.087268 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.087386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.087533 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.087651 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.087803 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.087931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.088087 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.088232 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.088355 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.088497 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.088623 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.088756 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.088980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.089067 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.089253 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.089544 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.089801 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.090068 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.090321 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 08:42:55.127396 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5567c2f2f9c0 pid: 93341 (default app) May 02 08:42:55.128596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5567c2f2f9c0 pid: 93340 (default app) May 02 08:42:55.130758 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97565ee9-86f1-4917-8ec9-7627ce0b6df6 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:42:55.131059 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97565ee9-86f1-4917-8ec9-7627ce0b6df6 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:42:55.131334 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97565ee9-86f1-4917-8ec9-7627ce0b6df6 None None] PATH_INFO: `/v3` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:42:55.135531 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Mon May 2 08:42:55 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:04.209853 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1ebd4-86c4-4f33-a755-114ebfa00f26 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:04.210439 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1ebd4-86c4-4f33-a755-114ebfa00f26 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:04.210439 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1ebd4-86c4-4f33-a755-114ebfa00f26 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:04.214755 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:04.219857 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc0252-a51f-44a4-aacc-e4323a66631f None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:04.220851 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc0252-a51f-44a4-aacc-e4323a66631f None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:04.221003 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc0252-a51f-44a4-aacc-e4323a66631f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:04.250849 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG oslo_db.sqlalchemy.engines [None req-e9dc0252-a51f-44a4-aacc-e4323a66631f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 02 08:43:04.433320 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG passlib.handlers.bcrypt [None req-e9dc0252-a51f-44a4-aacc-e4323a66631f None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=93341) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 02 08:43:04.433750 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG passlib.handlers.bcrypt [None req-e9dc0252-a51f-44a4-aacc-e4323a66631f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93341) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 02 08:43:04.489522 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-e9dc0252-a51f-44a4-aacc-e4323a66631f None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:04.491067 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-e9dc0252-a51f-44a4-aacc-e4323a66631f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:04.613458 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 02 08:43:04.767874 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1ebd4-86c4-4f33-a755-114ebfa00f26 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:04.802268 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG oslo_db.sqlalchemy.engines [None req-f3b1ebd4-86c4-4f33-a755-114ebfa00f26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 02 08:43:04.929766 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1ebd4-86c4-4f33-a755-114ebfa00f26 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:04.934120 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380e112-5745-4e5e-b753-0a9422d3cdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:04.934770 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380e112-5745-4e5e-b753-0a9422d3cdfa admin admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:04.935051 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380e112-5745-4e5e-b753-0a9422d3cdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:04.935325 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380e112-5745-4e5e-b753-0a9422d3cdfa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:04.943737 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380e112-5745-4e5e-b753-0a9422d3cdfa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:04.996089 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b380e112-5745-4e5e-b753-0a9422d3cdfa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 02 08:43:04.996428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380e112-5745-4e5e-b753-0a9422d3cdfa admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:05.006025 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Mon May 2 08:43:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 08:43:05.011980 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc0252-a51f-44a4-aacc-e4323a66631f None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:05.027063 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc0252-a51f-44a4-aacc-e4323a66631f None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:05.031521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc731f-7263-4902-b556-ea87320878c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:05.032669 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc731f-7263-4902-b556-ea87320878c5 admin admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:05.033764 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc731f-7263-4902-b556-ea87320878c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:05.034261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc731f-7263-4902-b556-ea87320878c5 admin admin] PATH_INFO: `/v3/projects/551938bc45944ca2b1d6b90c735fdb29` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:05.035796 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc731f-7263-4902-b556-ea87320878c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=551938bc45944ca2b1d6b90c735fdb29)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:05.086919 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: WARNING keystone.common.rbac_enforcer.enforcer [None req-92cc731f-7263-4902-b556-ea87320878c5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 02 08:43:05.087268 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc731f-7263-4902-b556-ea87320878c5 admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:05.093143 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Mon May 2 08:43:05 2022] GET /identity/v3/projects/551938bc45944ca2b1d6b90c735fdb29 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:07.352715 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b709d-90c6-47bc-b5a6-806c147dbe6d None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:07.353259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b709d-90c6-47bc-b5a6-806c147dbe6d None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:07.353342 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b709d-90c6-47bc-b5a6-806c147dbe6d None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:07.357366 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:07.363564 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17ffe2-5d6c-4ba7-bf64-2c17c6aacecd None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:07.364037 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17ffe2-5d6c-4ba7-bf64-2c17c6aacecd None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:07.364177 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17ffe2-5d6c-4ba7-bf64-2c17c6aacecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:07.491873 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-7f17ffe2-5d6c-4ba7-bf64-2c17c6aacecd None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:07.493440 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-7f17ffe2-5d6c-4ba7-bf64-2c17c6aacecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:07.501406 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 02 08:43:07.525431 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b709d-90c6-47bc-b5a6-806c147dbe6d None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:07.537352 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b709d-90c6-47bc-b5a6-806c147dbe6d None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:07.541524 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8ac89-667e-471d-b561-d36720fc4469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:07.542147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8ac89-667e-471d-b561-d36720fc4469 admin admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:07.542426 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8ac89-667e-471d-b561-d36720fc4469 admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:07.542697 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8ac89-667e-471d-b561-d36720fc4469 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:07.550866 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8ac89-667e-471d-b561-d36720fc4469 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:07.552666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8ac89-667e-471d-b561-d36720fc4469 admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:07.561237 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Mon May 2 08:43:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 08:43:07.567812 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17ffe2-5d6c-4ba7-bf64-2c17c6aacecd None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:07.576988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17ffe2-5d6c-4ba7-bf64-2c17c6aacecd None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:07.581680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8c03b-21b1-46d3-8cd6-04d807d26ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:07.582522 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8c03b-21b1-46d3-8cd6-04d807d26ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:07.582806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8c03b-21b1-46d3-8cd6-04d807d26ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:07.583083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8c03b-21b1-46d3-8cd6-04d807d26ee2 admin admin] PATH_INFO: `/v3/users/01d461fea7474f0cabc39359a0a27117` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:07.584517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8c03b-21b1-46d3-8cd6-04d807d26ee2 admin admin] RBAC: Authorizing `identity:get_user(user_id=01d461fea7474f0cabc39359a0a27117)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:07.586355 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8c03b-21b1-46d3-8cd6-04d807d26ee2 admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:07.587923 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Mon May 2 08:43:07 2022] GET /identity/v3/users/01d461fea7474f0cabc39359a0a27117 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:09.917867 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb060d-d8ff-4be2-8295-5c301aca5103 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:09.918356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb060d-d8ff-4be2-8295-5c301aca5103 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:09.918356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb060d-d8ff-4be2-8295-5c301aca5103 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:09.919671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:43:09.925707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bbc94-ec74-402e-9994-4c228597d3ce None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:09.926155 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bbc94-ec74-402e-9994-4c228597d3ce None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:09.926333 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bbc94-ec74-402e-9994-4c228597d3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:09.942487 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-df3bbc94-ec74-402e-9994-4c228597d3ce None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:09.943654 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-df3bbc94-ec74-402e-9994-4c228597d3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:09.975205 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c609d3b-de1b-46e3-a626-d28ed951b910 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:09.975497 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c609d3b-de1b-46e3-a626-d28ed951b910 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:09.975778 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c609d3b-de1b-46e3-a626-d28ed951b910 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:09.977158 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:43:09.982282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5b47e-8f53-4d27-8d01-9bfa5214d486 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:09.982573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5b47e-8f53-4d27-8d01-9bfa5214d486 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:09.982876 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5b47e-8f53-4d27-8d01-9bfa5214d486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:10.021319 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:43:10.022779 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG passlib.handlers.bcrypt [None req-c8c5b47e-8f53-4d27-8d01-9bfa5214d486 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=93340) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 02 08:43:10.023203 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG passlib.handlers.bcrypt [None req-c8c5b47e-8f53-4d27-8d01-9bfa5214d486 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93340) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 02 08:43:10.045716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bbc94-ec74-402e-9994-4c228597d3ce None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:10.070712 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-c8c5b47e-8f53-4d27-8d01-9bfa5214d486 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:10.072347 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-c8c5b47e-8f53-4d27-8d01-9bfa5214d486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:10.140213 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bbc94-ec74-402e-9994-4c228597d3ce None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:10.168853 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:43:10.171946 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f8a0-9267-4515-8127-027ab80f8814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:10.172785 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f8a0-9267-4515-8127-027ab80f8814 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:10.173064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f8a0-9267-4515-8127-027ab80f8814 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:10.174083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f8a0-9267-4515-8127-027ab80f8814 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:10.184849 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1f8a0-9267-4515-8127-027ab80f8814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:10.192219 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5b47e-8f53-4d27-8d01-9bfa5214d486 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:10.196134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-e6c1f8a0-9267-4515-8127-027ab80f8814 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:43:10.196134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:10.196134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:10.196134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:10.196134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:10.196134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:10.196134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:10.196134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:10.196134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:10.196134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:10.196134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:10.196134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:10.196134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:10.196134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:10.196134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:10.196134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:10.197036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:10.197036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:10.197036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:10.197036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:10.197036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:10.197036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:10.197036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:10.197036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:10.197036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:10.197036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:10.197036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:10.197036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:43:10.197036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:10.197036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:10.197036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:10.197036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:10.197824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:10.197824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:10.197824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:10.197824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:10.197824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:10.197824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:10.197824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:10.197824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:10.197824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:10.197824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:10.197824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:43:10.197824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:43:10.197824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Mon May 2 08:43:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:43:10.203240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f8a0-9267-4515-8127-027ab80f8814 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:10.287729 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5b47e-8f53-4d27-8d01-9bfa5214d486 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:10.296522 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f8a0-9267-4515-8127-027ab80f8814 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:10.319140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8042bef-acd9-4cfa-838a-14cb0b569760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:10.320024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8042bef-acd9-4cfa-838a-14cb0b569760 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:10.320342 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8042bef-acd9-4cfa-838a-14cb0b569760 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:10.320618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8042bef-acd9-4cfa-838a-14cb0b569760 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:10.328090 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e53c9c-b5c5-47c6-b93d-27154d03fc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:10.328747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e53c9c-b5c5-47c6-b93d-27154d03fc0f None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:10.329037 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e53c9c-b5c5-47c6-b93d-27154d03fc0f None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:10.329307 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e53c9c-b5c5-47c6-b93d-27154d03fc0f None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:10.330890 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e53c9c-b5c5-47c6-b93d-27154d03fc0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:10.331219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e53c9c-b5c5-47c6-b93d-27154d03fc0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:10.332654 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e53c9c-b5c5-47c6-b93d-27154d03fc0f None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:10.343937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:10.350045 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e53c9c-b5c5-47c6-b93d-27154d03fc0f None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:10.386320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8042bef-acd9-4cfa-838a-14cb0b569760 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:10.387852 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8042bef-acd9-4cfa-838a-14cb0b569760 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:10.443915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e53c9c-b5c5-47c6-b93d-27154d03fc0f None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:10.476392 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3d5ea-cf7b-4441-8958-76b67fe5f430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:10.477262 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3d5ea-cf7b-4441-8958-76b67fe5f430 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:10.477544 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3d5ea-cf7b-4441-8958-76b67fe5f430 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:10.477817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3d5ea-cf7b-4441-8958-76b67fe5f430 None admin] PATH_INFO: `/v3/users/01d461fea7474f0cabc39359a0a27117` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:10.479010 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3d5ea-cf7b-4441-8958-76b67fe5f430 None admin] RBAC: Authorizing `identity:get_user(user_id=01d461fea7474f0cabc39359a0a27117)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:10.480508 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3d5ea-cf7b-4441-8958-76b67fe5f430 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:10.480833 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 02 08:43:10.486491 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:10 2022] GET /identity/v3/users/01d461fea7474f0cabc39359a0a27117 => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:10.486638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8042bef-acd9-4cfa-838a-14cb0b569760 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:10.487442 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3d5ea-cf7b-4441-8958-76b67fe5f430 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:10.578180 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8042bef-acd9-4cfa-838a-14cb0b569760 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:10.580315 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3d5ea-cf7b-4441-8958-76b67fe5f430 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:10.609547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0785e-f121-4016-8525-08f4fdc06bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:10.610333 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0785e-f121-4016-8525-08f4fdc06bad None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:10.611151 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0785e-f121-4016-8525-08f4fdc06bad None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:10.611422 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0785e-f121-4016-8525-08f4fdc06bad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:10.612509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667669b-b6b1-4059-a8c6-0fc867bd63c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:10.613301 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667669b-b6b1-4059-a8c6-0fc867bd63c0 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:10.613582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667669b-b6b1-4059-a8c6-0fc867bd63c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:10.613853 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667669b-b6b1-4059-a8c6-0fc867bd63c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:10.615033 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667669b-b6b1-4059-a8c6-0fc867bd63c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:10.616530 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667669b-b6b1-4059-a8c6-0fc867bd63c0 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:10.618274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:43:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:10.623751 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667669b-b6b1-4059-a8c6-0fc867bd63c0 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:10.630015 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0785e-f121-4016-8525-08f4fdc06bad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:10.633442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0785e-f121-4016-8525-08f4fdc06bad None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:10.654703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-ded0785e-f121-4016-8525-08f4fdc06bad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:43:10.654703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:10.654703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:10.654703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:10.654703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:10.654703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:10.654703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:10.654703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:10.654703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:10.654703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:10.654703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:10.654703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:10.654703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:43:10.654703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:43:10.654703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:43:10.655573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:43:10.655573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:10.655573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:10.655573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:10.655573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:10.655573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:10.655573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:10.655573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:10.655573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:10.655573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:10.655573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:10.655573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:10.655573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:10.655573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:10.655573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:10.655573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:10.655573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:10.659709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:43:10.659709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:43:10.659709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:43:10.659709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:10.659709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:10.662199 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0785e-f121-4016-8525-08f4fdc06bad None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:10.722659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667669b-b6b1-4059-a8c6-0fc867bd63c0 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:10.754536 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8065aa0-3eb0-478d-8d6f-326ac820b006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:10.755194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8065aa0-3eb0-478d-8d6f-326ac820b006 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:10.755481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8065aa0-3eb0-478d-8d6f-326ac820b006 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:10.755754 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8065aa0-3eb0-478d-8d6f-326ac820b006 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:10.756611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8065aa0-3eb0-478d-8d6f-326ac820b006 None admin] RBAC: Adding query filter params (role.id=509216a314244b96b05d3fe56b0d9cd1, scope.domain.id=default, user.id=01d461fea7474f0cabc39359a0a27117) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:10.756799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0785e-f121-4016-8525-08f4fdc06bad None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:10.756904 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8065aa0-3eb0-478d-8d6f-326ac820b006 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:10.758371 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8065aa0-3eb0-478d-8d6f-326ac820b006 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:10.764857 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Mon May 2 08:43:10 2022] GET /identity/v3/role_assignments?user.id=01d461fea7474f0cabc39359a0a27117&scope.domain.id=default&role.id=509216a314244b96b05d3fe56b0d9cd1 => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:10.790676 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f3a9b-5c6f-4f20-89ac-ad42ced7241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:10.791350 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f3a9b-5c6f-4f20-89ac-ad42ced7241c None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:10.791636 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f3a9b-5c6f-4f20-89ac-ad42ced7241c None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:10.791910 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f3a9b-5c6f-4f20-89ac-ad42ced7241c None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:10.792698 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f3a9b-5c6f-4f20-89ac-ad42ced7241c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:10.793006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f3a9b-5c6f-4f20-89ac-ad42ced7241c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:10.794463 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f3a9b-5c6f-4f20-89ac-ad42ced7241c None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:10.814137 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:13.638600 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc315196-f09c-49e9-a43c-0b84c25838a1 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:13.639606 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc315196-f09c-49e9-a43c-0b84c25838a1 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:13.640151 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc315196-f09c-49e9-a43c-0b84c25838a1 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:13.642164 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:13.647338 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeff714-e743-4fd2-a96c-4558d5c3f05d None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:13.647770 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeff714-e743-4fd2-a96c-4558d5c3f05d None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:13.649628 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeff714-e743-4fd2-a96c-4558d5c3f05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:13.670612 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-5eeff714-e743-4fd2-a96c-4558d5c3f05d None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:13.672006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-5eeff714-e743-4fd2-a96c-4558d5c3f05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:13.752356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:13.787050 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc315196-f09c-49e9-a43c-0b84c25838a1 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:13.801443 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a4984-dc9e-4860-8559-56151c9ee998 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:13.801983 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a4984-dc9e-4860-8559-56151c9ee998 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:13.802411 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a4984-dc9e-4860-8559-56151c9ee998 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:13.803965 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:43:13.830904 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804e3f3-9e50-4409-8f74-82d9ee7c95fa None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:13.831590 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804e3f3-9e50-4409-8f74-82d9ee7c95fa None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:13.835446 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804e3f3-9e50-4409-8f74-82d9ee7c95fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:13.963190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-c804e3f3-9e50-4409-8f74-82d9ee7c95fa None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:13.964459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-c804e3f3-9e50-4409-8f74-82d9ee7c95fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:13.997737 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc315196-f09c-49e9-a43c-0b84c25838a1 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:14.065131 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8264b-457d-4709-b413-05f0e645cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:14.066531 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 13/25] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:14.066644 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8264b-457d-4709-b413-05f0e645cd7d None admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:14.066963 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8264b-457d-4709-b413-05f0e645cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:14.067293 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8264b-457d-4709-b413-05f0e645cd7d None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:14.068421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8264b-457d-4709-b413-05f0e645cd7d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:14.069997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8264b-457d-4709-b413-05f0e645cd7d None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:14.108631 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804e3f3-9e50-4409-8f74-82d9ee7c95fa None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:14.243756 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804e3f3-9e50-4409-8f74-82d9ee7c95fa None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:14.277116 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8a958-1bd1-424d-8d32-b72d39697fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:14.278143 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8a958-1bd1-424d-8d32-b72d39697fdf None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:14.278594 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8a958-1bd1-424d-8d32-b72d39697fdf None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:14.279007 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8a958-1bd1-424d-8d32-b72d39697fdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:14.290922 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8a958-1bd1-424d-8d32-b72d39697fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:14.300006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-a2c8a958-1bd1-424d-8d32-b72d39697fdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:43:14.300006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:14.300006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:14.300006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:14.300006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:14.300006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:14.300006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:14.300006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:14.300006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:14.300006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:14.300006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:14.300006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:14.300006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:14.300006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:14.300006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:14.300006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:14.301088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:14.301088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:14.301088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:14.301088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:14.301088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:14.301088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:14.301088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:14.301088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:14.301088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:14.301088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:14.301088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:14.301088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:14.301088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:14.301088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:14.301088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:14.301088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:14.302039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:14.302039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:14.302039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:14.302039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:14.302039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:14.302039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:14.302039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:14.302039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:14.302039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:14.302039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:14.302039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:43:14.302039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:14.302725 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 13/26] 10.222.0.18 () {60 vars in 1131 bytes} [Mon May 2 08:43:13 2022] POST /identity/v3/roles => generated 219 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:43:14.303892 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5693d-f892-4bec-94b1-549751a8778e None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:14.304219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5693d-f892-4bec-94b1-549751a8778e None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:14.304510 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5693d-f892-4bec-94b1-549751a8778e None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:14.304784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 14/27] 10.222.0.18 () {56 vars in 1096 bytes} [Mon May 2 08:43:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:43:14.306139 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 14/28] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:14.306669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e9bcc-a1e7-4a7c-bd56-29d8975f9069 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:14.307178 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e9bcc-a1e7-4a7c-bd56-29d8975f9069 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:14.307651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e9bcc-a1e7-4a7c-bd56-29d8975f9069 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:14.309879 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 15/29] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:14.313055 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5693d-f892-4bec-94b1-549751a8778e None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:14.315092 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68d658-9e88-469c-87ad-f747c0e86a60 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:14.315662 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68d658-9e88-469c-87ad-f747c0e86a60 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:14.316322 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68d658-9e88-469c-87ad-f747c0e86a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:14.344480 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-1c68d658-9e88-469c-87ad-f747c0e86a60 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:14.348226 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-1c68d658-9e88-469c-87ad-f747c0e86a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:14.480878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 16/30] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:14.482721 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942b6f6-8abe-4718-aa15-eb758edbb7c2 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:14.483796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942b6f6-8abe-4718-aa15-eb758edbb7c2 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:14.484739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942b6f6-8abe-4718-aa15-eb758edbb7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:14.517334 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-5942b6f6-8abe-4718-aa15-eb758edbb7c2 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:14.517334 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-5942b6f6-8abe-4718-aa15-eb758edbb7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:14.519135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5693d-f892-4bec-94b1-549751a8778e None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:14.561409 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f5706-e80c-48a1-bc99-9a1082dccefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:14.562500 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f5706-e80c-48a1-bc99-9a1082dccefd None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:14.563007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f5706-e80c-48a1-bc99-9a1082dccefd None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:14.564001 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f5706-e80c-48a1-bc99-9a1082dccefd None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:14.565279 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f5706-e80c-48a1-bc99-9a1082dccefd None admin] RBAC: Adding query filter params (name=admin) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:14.565815 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f5706-e80c-48a1-bc99-9a1082dccefd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:14.567622 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f5706-e80c-48a1-bc99-9a1082dccefd None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:14.579986 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 15/31] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:14.581716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f5706-e80c-48a1-bc99-9a1082dccefd None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:14.615276 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 17/32] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:14.616921 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942b6f6-8abe-4718-aa15-eb758edbb7c2 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:14.708444 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f5706-e80c-48a1-bc99-9a1082dccefd None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:14.726194 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942b6f6-8abe-4718-aa15-eb758edbb7c2 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:14.746526 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe04c7-cb03-4e06-8235-1a1b0b9c482e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:14.747510 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe04c7-cb03-4e06-8235-1a1b0b9c482e None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:14.747910 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe04c7-cb03-4e06-8235-1a1b0b9c482e None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:14.748323 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe04c7-cb03-4e06-8235-1a1b0b9c482e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:14.762251 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe04c7-cb03-4e06-8235-1a1b0b9c482e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:14.763958 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe04c7-cb03-4e06-8235-1a1b0b9c482e None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:14.765710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a8373-0166-446b-9883-a498632a95b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:14.767478 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a8373-0166-446b-9883-a498632a95b1 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:14.767941 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a8373-0166-446b-9883-a498632a95b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:14.768437 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a8373-0166-446b-9883-a498632a95b1 None admin] PATH_INFO: `/v3/users/01d461fea7474f0cabc39359a0a27117` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:14.770194 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a8373-0166-446b-9883-a498632a95b1 None admin] RBAC: Authorizing `identity:get_user(user_id=01d461fea7474f0cabc39359a0a27117)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:14.771842 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a8373-0166-446b-9883-a498632a95b1 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:14.774189 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 18/33] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:14 2022] GET /identity/v3/users/01d461fea7474f0cabc39359a0a27117 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:14.775330 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a8373-0166-446b-9883-a498632a95b1 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:14.786052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-defe04c7-cb03-4e06-8235-1a1b0b9c482e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:43:14.786052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:14.786052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:14.786052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:14.786052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:14.786052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:14.786052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:14.786052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:14.786052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:14.786052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:14.786052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:14.786052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:14.786052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:43:14.786052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:43:14.786052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:43:14.786909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:43:14.786909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:14.786909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:14.786909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:14.786909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:14.786909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:14.786909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:14.786909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:14.786909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:43:14.786909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:14.786909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:14.786909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:14.786909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:14.786909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:14.786909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:14.786909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:14.786909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:14.788224 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:43:14.788224 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:43:14.788224 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:43:14.788224 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:43:14.788224 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 16/34] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:14.792298 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe04c7-cb03-4e06-8235-1a1b0b9c482e None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:14.880568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a8373-0166-446b-9883-a498632a95b1 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:14.897663 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe04c7-cb03-4e06-8235-1a1b0b9c482e None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:14.914998 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8c39e-dc0e-4211-801a-30fcd602be98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:14.915681 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8c39e-dc0e-4211-801a-30fcd602be98 None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:14.915968 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8c39e-dc0e-4211-801a-30fcd602be98 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:14.916345 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8c39e-dc0e-4211-801a-30fcd602be98 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:14.917206 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8c39e-dc0e-4211-801a-30fcd602be98 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:14.918608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8c39e-dc0e-4211-801a-30fcd602be98 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:14.931269 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bec23-54cf-4693-8626-d6a907087181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:14.932097 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bec23-54cf-4693-8626-d6a907087181 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:14.932434 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bec23-54cf-4693-8626-d6a907087181 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:14.932716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bec23-54cf-4693-8626-d6a907087181 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:14.933901 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bec23-54cf-4693-8626-d6a907087181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:14.938942 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bec23-54cf-4693-8626-d6a907087181 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:14.938942 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 17/35] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:43:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:14.938942 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bec23-54cf-4693-8626-d6a907087181 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:15.035520 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bec23-54cf-4693-8626-d6a907087181 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:15.068396 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511907f-bceb-4685-ac11-252d2d072830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:15.069071 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511907f-bceb-4685-ac11-252d2d072830 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:15.069357 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511907f-bceb-4685-ac11-252d2d072830 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:15.069627 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511907f-bceb-4685-ac11-252d2d072830 None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:15.070359 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511907f-bceb-4685-ac11-252d2d072830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:15.070672 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511907f-bceb-4685-ac11-252d2d072830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:15.072121 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511907f-bceb-4685-ac11-252d2d072830 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:15.089302 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 18/36] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:15.090427 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a4346-2111-4daa-912e-44846ab5660b None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:15.090727 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a4346-2111-4daa-912e-44846ab5660b None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:15.091008 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a4346-2111-4daa-912e-44846ab5660b None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:15.092294 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 19/37] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:15.096946 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a4346-2111-4daa-912e-44846ab5660b None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:15.128078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 19/38] 10.222.0.18 () {60 vars in 1131 bytes} [Mon May 2 08:43:14 2022] POST /identity/v3/roles => generated 225 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:43:15.128078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8c39e-dc0e-4211-801a-30fcd602be98 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:15.234435 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a4346-2111-4daa-912e-44846ab5660b None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:15.243838 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8c39e-dc0e-4211-801a-30fcd602be98 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:15.279770 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b9fc4-af81-432e-b889-41f7d5dbd12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:15.280339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c81b24-2f9a-4866-b177-e4182f54c148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:15.280932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b9fc4-af81-432e-b889-41f7d5dbd12c None admin] REQUEST_METHOD: `PUT` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:15.281164 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c81b24-2f9a-4866-b177-e4182f54c148 None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:15.281361 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b9fc4-af81-432e-b889-41f7d5dbd12c None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:15.281585 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c81b24-2f9a-4866-b177-e4182f54c148 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:15.281814 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b9fc4-af81-432e-b889-41f7d5dbd12c None admin] PATH_INFO: `/v3/domains/default/users/01d461fea7474f0cabc39359a0a27117/roles/509216a314244b96b05d3fe56b0d9cd1` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:15.281973 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c81b24-2f9a-4866-b177-e4182f54c148 None admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:15.283339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c81b24-2f9a-4866-b177-e4182f54c148 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:15.285012 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b9fc4-af81-432e-b889-41f7d5dbd12c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=01d461fea7474f0cabc39359a0a27117, role_id=509216a314244b96b05d3fe56b0d9cd1)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:15.285199 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c81b24-2f9a-4866-b177-e4182f54c148 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:15.286744 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b9fc4-af81-432e-b889-41f7d5dbd12c None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:15.395244 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 20/39] 10.222.0.18 () {58 vars in 1361 bytes} [Mon May 2 08:43:15 2022] PUT /identity/v3/domains/default/users/01d461fea7474f0cabc39359a0a27117/roles/509216a314244b96b05d3fe56b0d9cd1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:43:15.396547 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5def3f-4f94-4a20-995b-ecf1e0ca6948 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:15.396839 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5def3f-4f94-4a20-995b-ecf1e0ca6948 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:15.397233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5def3f-4f94-4a20-995b-ecf1e0ca6948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:15.415881 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-6e5def3f-4f94-4a20-995b-ecf1e0ca6948 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:15.417481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-6e5def3f-4f94-4a20-995b-ecf1e0ca6948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:15.434277 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 20/40] 10.222.0.18 () {60 vars in 1141 bytes} [Mon May 2 08:43:15 2022] POST /identity/v3/projects => generated 301 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:43:15.435895 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc748997-d67e-4fa0-8584-ae8e974f362e None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:15.436295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc748997-d67e-4fa0-8584-ae8e974f362e None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:15.436735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc748997-d67e-4fa0-8584-ae8e974f362e None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:15.438503 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 21/41] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:15.444413 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dfd54-009d-4c74-bfef-a2ba0a1f7998 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:15.444702 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dfd54-009d-4c74-bfef-a2ba0a1f7998 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:15.445111 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dfd54-009d-4c74-bfef-a2ba0a1f7998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:15.464621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-1a7dfd54-009d-4c74-bfef-a2ba0a1f7998 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:15.466565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-1a7dfd54-009d-4c74-bfef-a2ba0a1f7998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:15.519847 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 21/42] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:15.545274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5def3f-4f94-4a20-995b-ecf1e0ca6948 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:15.558060 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 22/43] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:43:15.585070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dfd54-009d-4c74-bfef-a2ba0a1f7998 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:15.675113 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5def3f-4f94-4a20-995b-ecf1e0ca6948 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:15.702342 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dfd54-009d-4c74-bfef-a2ba0a1f7998 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:15.711935 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b77c7-1fe1-4be5-b1c8-658bc3d64668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:15.712601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b77c7-1fe1-4be5-b1c8-658bc3d64668 None admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:15.713058 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b77c7-1fe1-4be5-b1c8-658bc3d64668 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:15.713341 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b77c7-1fe1-4be5-b1c8-658bc3d64668 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:15.714098 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b77c7-1fe1-4be5-b1c8-658bc3d64668 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:15.715510 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b77c7-1fe1-4be5-b1c8-658bc3d64668 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:15.740589 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af43d2e-f6ca-4903-806a-afc8944c2dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:15.741389 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af43d2e-f6ca-4903-806a-afc8944c2dca None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:15.741678 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af43d2e-f6ca-4903-806a-afc8944c2dca None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:15.741958 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af43d2e-f6ca-4903-806a-afc8944c2dca None admin] PATH_INFO: `/v3/domains/default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:15.743152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af43d2e-f6ca-4903-806a-afc8944c2dca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:15.744678 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af43d2e-f6ca-4903-806a-afc8944c2dca None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:15.746304 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 23/44] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:43:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:15.752189 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af43d2e-f6ca-4903-806a-afc8944c2dca None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:15.807059 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1131 bytes} [Mon May 2 08:43:15 2022] POST /identity/v3/roles => generated 223 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:43:15.854654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af43d2e-f6ca-4903-806a-afc8944c2dca None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:15.890858 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324adcb2-3004-4627-bfed-0acc24776fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:15.891535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324adcb2-3004-4627-bfed-0acc24776fef None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:15.892448 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324adcb2-3004-4627-bfed-0acc24776fef None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:15.892831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324adcb2-3004-4627-bfed-0acc24776fef None admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:15.893697 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324adcb2-3004-4627-bfed-0acc24776fef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:15.895194 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324adcb2-3004-4627-bfed-0acc24776fef None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:15.984096 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1141 bytes} [Mon May 2 08:43:15 2022] POST /identity/v3/projects => generated 312 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 08:43:17.777829 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6460d-83c4-495f-b4e9-9cfbcfbd30f1 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:17.778345 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6460d-83c4-495f-b4e9-9cfbcfbd30f1 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:17.778576 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6460d-83c4-495f-b4e9-9cfbcfbd30f1 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:17.779964 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 23/47] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:43:17.786583 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa4878-aca0-42a6-9d9b-744d81140350 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:17.787054 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa4878-aca0-42a6-9d9b-744d81140350 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:17.787149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa4878-aca0-42a6-9d9b-744d81140350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:17.804349 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-a9aa4878-aca0-42a6-9d9b-744d81140350 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:17.805627 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-a9aa4878-aca0-42a6-9d9b-744d81140350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:17.873383 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 25/48] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:17.899557 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6460d-83c4-495f-b4e9-9cfbcfbd30f1 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:18.015734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6460d-83c4-495f-b4e9-9cfbcfbd30f1 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:18.051948 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60ca1e-a962-4ce8-8fc8-cc5f3e3b7fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:18.053196 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60ca1e-a962-4ce8-8fc8-cc5f3e3b7fb2 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:18.053681 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60ca1e-a962-4ce8-8fc8-cc5f3e3b7fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:18.054019 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60ca1e-a962-4ce8-8fc8-cc5f3e3b7fb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:18.067622 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60ca1e-a962-4ce8-8fc8-cc5f3e3b7fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:18.075747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-ad60ca1e-a962-4ce8-8fc8-cc5f3e3b7fb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:43:18.075747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:18.075747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:18.075747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:18.075747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:18.075747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:18.075747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:18.075747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:18.075747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:18.075747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:18.075747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:18.075747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:18.075747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:18.075747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:18.075747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:18.075747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:18.076630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:18.076630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:18.076630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:18.076630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:18.076630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:18.076630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:18.076630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:18.076630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:18.076630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:18.076630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:18.076630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:18.076630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:43:18.076630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:18.076630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:18.076630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:18.076630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:18.077369 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:18.077369 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:18.077369 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:18.077369 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:18.077369 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:18.077369 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:18.077369 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:18.077369 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:18.077369 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:18.077369 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:18.077369 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:43:18.077369 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:43:18.077369 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 24/49] 10.222.0.18 () {56 vars in 1096 bytes} [Mon May 2 08:43:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:18.084073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa4878-aca0-42a6-9d9b-744d81140350 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:18.201903 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa4878-aca0-42a6-9d9b-744d81140350 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:18.242247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3116a-546a-4e0c-8716-67049ac81d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:18.242924 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3116a-546a-4e0c-8716-67049ac81d93 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:18.243214 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3116a-546a-4e0c-8716-67049ac81d93 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:18.243495 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3116a-546a-4e0c-8716-67049ac81d93 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:18.244286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3116a-546a-4e0c-8716-67049ac81d93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:18.244602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3116a-546a-4e0c-8716-67049ac81d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:18.245999 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3116a-546a-4e0c-8716-67049ac81d93 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:18.267736 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 26/50] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:18.268971 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60ca1e-a962-4ce8-8fc8-cc5f3e3b7fb2 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:18.351066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf85082-de99-4c07-94cd-34eef0fee5bf None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:18.351356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf85082-de99-4c07-94cd-34eef0fee5bf None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:18.351641 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf85082-de99-4c07-94cd-34eef0fee5bf None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:18.353045 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 27/51] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:18.358147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6833-06d4-45e1-9928-77d6544ebe83 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:18.358509 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6833-06d4-45e1-9928-77d6544ebe83 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:18.358860 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6833-06d4-45e1-9928-77d6544ebe83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:18.366567 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60ca1e-a962-4ce8-8fc8-cc5f3e3b7fb2 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:18.375052 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-927f6833-06d4-45e1-9928-77d6544ebe83 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:18.376786 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-927f6833-06d4-45e1-9928-77d6544ebe83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:18.400027 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccab8b8-1a23-4641-866e-def0631b5899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:18.400933 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccab8b8-1a23-4641-866e-def0631b5899 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:18.401231 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccab8b8-1a23-4641-866e-def0631b5899 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:18.401566 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccab8b8-1a23-4641-866e-def0631b5899 None admin] PATH_INFO: `/v3/users/01d461fea7474f0cabc39359a0a27117` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:18.402851 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccab8b8-1a23-4641-866e-def0631b5899 None admin] RBAC: Authorizing `identity:get_user(user_id=01d461fea7474f0cabc39359a0a27117)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:18.404376 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccab8b8-1a23-4641-866e-def0631b5899 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:18.406224 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 25/52] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:18 2022] GET /identity/v3/users/01d461fea7474f0cabc39359a0a27117 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:18.411507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccab8b8-1a23-4641-866e-def0631b5899 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:18.442531 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 28/53] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:43:18.467327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f6833-06d4-45e1-9928-77d6544ebe83 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:18.506866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccab8b8-1a23-4641-866e-def0631b5899 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:18.538404 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dce6ed-9c65-44e5-8efa-b5fa4e8c6366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:18.539119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dce6ed-9c65-44e5-8efa-b5fa4e8c6366 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:18.539434 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dce6ed-9c65-44e5-8efa-b5fa4e8c6366 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:18.539720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dce6ed-9c65-44e5-8efa-b5fa4e8c6366 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:18.540912 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dce6ed-9c65-44e5-8efa-b5fa4e8c6366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:18.542362 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dce6ed-9c65-44e5-8efa-b5fa4e8c6366 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:18.543962 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 26/54] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:43:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:18.550654 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dce6ed-9c65-44e5-8efa-b5fa4e8c6366 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:18.563158 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f6833-06d4-45e1-9928-77d6544ebe83 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:18.596417 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0076efe-3fcb-42bf-823f-e49a6f232d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:18.597208 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0076efe-3fcb-42bf-823f-e49a6f232d26 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:18.597492 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0076efe-3fcb-42bf-823f-e49a6f232d26 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:18.597769 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0076efe-3fcb-42bf-823f-e49a6f232d26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:18.598951 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0076efe-3fcb-42bf-823f-e49a6f232d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:18.600462 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0076efe-3fcb-42bf-823f-e49a6f232d26 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:18.602076 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 29/55] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:43:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:18.607482 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0076efe-3fcb-42bf-823f-e49a6f232d26 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:18.650656 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dce6ed-9c65-44e5-8efa-b5fa4e8c6366 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:18.684659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ff16f-bf7a-4b19-a066-2e07e32c47db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:18.685325 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ff16f-bf7a-4b19-a066-2e07e32c47db None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:18.685611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ff16f-bf7a-4b19-a066-2e07e32c47db None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:18.685891 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ff16f-bf7a-4b19-a066-2e07e32c47db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:18.686729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ff16f-bf7a-4b19-a066-2e07e32c47db None admin] RBAC: Adding query filter params (role.id=509216a314244b96b05d3fe56b0d9cd1, scope.domain.id=default, user.id=01d461fea7474f0cabc39359a0a27117) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:18.687046 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ff16f-bf7a-4b19-a066-2e07e32c47db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:18.688722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ff16f-bf7a-4b19-a066-2e07e32c47db None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:18.694753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 27/56] 10.222.0.18 () {56 vars in 1322 bytes} [Mon May 2 08:43:18 2022] GET /identity/v3/role_assignments?user.id=01d461fea7474f0cabc39359a0a27117&scope.domain.id=default&role.id=509216a314244b96b05d3fe56b0d9cd1 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:18.706075 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0076efe-3fcb-42bf-823f-e49a6f232d26 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:18.742529 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed99431-022f-4e91-a6c5-f384a2774b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:18.743202 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed99431-022f-4e91-a6c5-f384a2774b9b None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:18.743491 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed99431-022f-4e91-a6c5-f384a2774b9b None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:18.743770 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed99431-022f-4e91-a6c5-f384a2774b9b None admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:18.744530 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed99431-022f-4e91-a6c5-f384a2774b9b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:18.746024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed99431-022f-4e91-a6c5-f384a2774b9b None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:18.817222 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 30/57] 10.222.0.18 () {60 vars in 1140 bytes} [Mon May 2 08:43:18 2022] POST /identity/v3/projects => generated 298 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 08:43:21.114225 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59ea54-7501-40ba-b1b8-7683556c9246 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:21.114732 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59ea54-7501-40ba-b1b8-7683556c9246 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:21.114732 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59ea54-7501-40ba-b1b8-7683556c9246 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:21.116087 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 28/58] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:21.121305 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80269945-a7d9-44ff-8af3-e3bb8eef7ce2 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:21.121704 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80269945-a7d9-44ff-8af3-e3bb8eef7ce2 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:21.121869 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80269945-a7d9-44ff-8af3-e3bb8eef7ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:21.138543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-80269945-a7d9-44ff-8af3-e3bb8eef7ce2 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:21.139732 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-80269945-a7d9-44ff-8af3-e3bb8eef7ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:21.203757 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 31/59] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:21.229256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59ea54-7501-40ba-b1b8-7683556c9246 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:21.325172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59ea54-7501-40ba-b1b8-7683556c9246 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:21.356588 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f19cfa-1467-4558-85fc-4594a291917a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:21.357377 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f19cfa-1467-4558-85fc-4594a291917a None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:21.357664 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f19cfa-1467-4558-85fc-4594a291917a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:21.357943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f19cfa-1467-4558-85fc-4594a291917a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:21.359145 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f19cfa-1467-4558-85fc-4594a291917a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:21.361228 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f19cfa-1467-4558-85fc-4594a291917a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:21.362820 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 29/60] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:43:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:21.368264 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80269945-a7d9-44ff-8af3-e3bb8eef7ce2 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:21.460342 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80269945-a7d9-44ff-8af3-e3bb8eef7ce2 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:21.492627 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f5184-27b2-4d42-8b3e-c7ad0e8d03d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:21.493288 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f5184-27b2-4d42-8b3e-c7ad0e8d03d6 None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:21.493577 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f5184-27b2-4d42-8b3e-c7ad0e8d03d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:21.493856 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f5184-27b2-4d42-8b3e-c7ad0e8d03d6 None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:21.494569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f5184-27b2-4d42-8b3e-c7ad0e8d03d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:21.496029 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f5184-27b2-4d42-8b3e-c7ad0e8d03d6 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:21.595190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 32/61] 10.222.0.18 () {60 vars in 1132 bytes} [Mon May 2 08:43:21 2022] POST /identity/v3/users => generated 275 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 08:43:25.234118 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0ef78-2362-43e4-8533-a8f73c78aea8 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:25.235230 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0ef78-2362-43e4-8533-a8f73c78aea8 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:25.235750 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0ef78-2362-43e4-8533-a8f73c78aea8 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:25.237549 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 30/62] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:25.243201 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d72e6-d43d-4535-9d19-d4ee2ea44844 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:25.244085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d72e6-d43d-4535-9d19-d4ee2ea44844 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:25.244580 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d72e6-d43d-4535-9d19-d4ee2ea44844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:25.269118 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-5b5d72e6-d43d-4535-9d19-d4ee2ea44844 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:25.271664 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbad76-b94a-4eb0-b1e0-7179e0224add None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:25.272196 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbad76-b94a-4eb0-b1e0-7179e0224add None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:25.272706 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbad76-b94a-4eb0-b1e0-7179e0224add None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:25.274271 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:43:25.275044 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-5b5d72e6-d43d-4535-9d19-d4ee2ea44844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:25.279280 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f8ddc-b605-4bcd-806e-e010fbc35a20 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:25.279794 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f8ddc-b605-4bcd-806e-e010fbc35a20 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:25.280318 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f8ddc-b605-4bcd-806e-e010fbc35a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:25.300113 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-5b2f8ddc-b605-4bcd-806e-e010fbc35a20 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:25.301653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-5b2f8ddc-b605-4bcd-806e-e010fbc35a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:25.357128 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 33/64] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:25.358927 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00682d6-ef0a-44cc-99be-4b3e403336c8 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:25.359220 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00682d6-ef0a-44cc-99be-4b3e403336c8 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:25.359501 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00682d6-ef0a-44cc-99be-4b3e403336c8 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:25.362017 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 34/65] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:25.367364 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7bac6-1472-475d-8207-e8b8eaf1b2f3 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:25.367869 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7bac6-1472-475d-8207-e8b8eaf1b2f3 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:25.368367 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7bac6-1472-475d-8207-e8b8eaf1b2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:25.375985 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 32/66] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:43:25.386272 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-6be7bac6-1472-475d-8207-e8b8eaf1b2f3 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:25.388808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-6be7bac6-1472-475d-8207-e8b8eaf1b2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:25.401486 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f8ddc-b605-4bcd-806e-e010fbc35a20 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:25.457711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 35/67] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:43:25.458923 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7bac6-1472-475d-8207-e8b8eaf1b2f3 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:25.524703 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f8ddc-b605-4bcd-806e-e010fbc35a20 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:25.564351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2908b-b8ab-494f-be51-89b0ff29bdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:25.565423 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2908b-b8ab-494f-be51-89b0ff29bdef None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:25.565850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2908b-b8ab-494f-be51-89b0ff29bdef None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:25.566361 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2908b-b8ab-494f-be51-89b0ff29bdef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:25.577489 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2908b-b8ab-494f-be51-89b0ff29bdef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:25.578066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7bac6-1472-475d-8207-e8b8eaf1b2f3 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:25.586739 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-d1e2908b-b8ab-494f-be51-89b0ff29bdef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:43:25.586739 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:25.586739 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:25.586739 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:25.586739 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:25.586739 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:25.586739 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:25.586739 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:25.586739 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:25.586739 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:25.586739 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:25.586739 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:25.586739 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:25.586739 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:25.586739 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:25.586739 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:25.587666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:25.587666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:25.587666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:25.587666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:25.587666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:25.587666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:25.587666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:25.587666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:25.587666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:25.587666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:25.587666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:25.587666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:43:25.587666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:25.587666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:25.587666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:25.587666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:25.588477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:25.588477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:25.588477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:25.588477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:25.588477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:25.588477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:25.588477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:25.588477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:25.588477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:25.588477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:25.588477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:43:25.588477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:43:25.596134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 33/68] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:43:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:25.597457 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2908b-b8ab-494f-be51-89b0ff29bdef None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:25.617669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26645ac9-d572-40e9-8841-3286f0c36c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:25.618589 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26645ac9-d572-40e9-8841-3286f0c36c9a None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:25.618956 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26645ac9-d572-40e9-8841-3286f0c36c9a None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:25.619313 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26645ac9-d572-40e9-8841-3286f0c36c9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:25.631433 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26645ac9-d572-40e9-8841-3286f0c36c9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:25.639649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-26645ac9-d572-40e9-8841-3286f0c36c9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:25.639649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:25.639649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:25.639649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:25.639649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:25.639649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:25.639649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:25.639649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:25.639649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:25.639649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:25.639649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:25.639649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:25.639649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:25.639649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:25.639649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:25.639649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:25.640551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:25.640551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:25.640551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:25.640551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:25.640551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:25.640551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:25.640551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:25.640551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:25.640551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:25.640551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:25.640551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:25.640551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:25.640551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:25.640551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:25.640551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:25.640551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:25.641441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:25.641441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:25.641441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:25.641441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:25.641441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:25.641441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:25.641441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:25.641441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:25.641441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:25.641441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:25.641441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:25.641441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:25.641441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 36/69] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:25.642952 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26645ac9-d572-40e9-8841-3286f0c36c9a None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:25.710190 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2908b-b8ab-494f-be51-89b0ff29bdef None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:25.745359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26645ac9-d572-40e9-8841-3286f0c36c9a None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:25.745815 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd23e0b-94c3-49cb-a273-988853038edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:25.746623 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd23e0b-94c3-49cb-a273-988853038edb None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:25.746932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd23e0b-94c3-49cb-a273-988853038edb None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:25.747182 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd23e0b-94c3-49cb-a273-988853038edb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:25.757991 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd23e0b-94c3-49cb-a273-988853038edb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:25.765723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-afd23e0b-94c3-49cb-a273-988853038edb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:43:25.765723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:25.765723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:25.765723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:25.765723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:25.765723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:25.765723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:25.765723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:25.765723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:25.765723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:25.765723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:25.765723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:25.765723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:25.765723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:25.765723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:25.765723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:25.767137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:25.767137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:25.767137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:25.767137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:25.767137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:25.767137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:25.767137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:25.767137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:25.767137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:25.767137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:25.767137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:25.767137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:43:25.767137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:25.767137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:25.767137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:25.767137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:25.767894 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:25.767894 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:25.767894 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:25.767894 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:25.767894 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:25.767894 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:25.767894 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:25.767894 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:25.767894 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:25.767894 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:25.767894 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:43:25.767894 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:43:25.767894 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 34/70] 10.222.0.18 () {56 vars in 1096 bytes} [Mon May 2 08:43:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:25.769131 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd23e0b-94c3-49cb-a273-988853038edb None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:25.789847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2a69d-81ff-4585-9cd8-36ec20c0b270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:25.790447 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2a69d-81ff-4585-9cd8-36ec20c0b270 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:25.790736 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2a69d-81ff-4585-9cd8-36ec20c0b270 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:25.791016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2a69d-81ff-4585-9cd8-36ec20c0b270 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:25.791778 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2a69d-81ff-4585-9cd8-36ec20c0b270 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:25.792121 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2a69d-81ff-4585-9cd8-36ec20c0b270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:25.793545 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2a69d-81ff-4585-9cd8-36ec20c0b270 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:25.802782 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 37/71] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:43:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:25.803977 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8695e5a-c762-443d-a0da-fde35833df66 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:25.804306 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8695e5a-c762-443d-a0da-fde35833df66 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:25.804591 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8695e5a-c762-443d-a0da-fde35833df66 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:25.808864 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 38/72] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:25.808864 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8695e5a-c762-443d-a0da-fde35833df66 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:25.870138 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd23e0b-94c3-49cb-a273-988853038edb None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:25.901956 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f260db7-d141-4900-a2ca-d31acf654244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:25.902629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f260db7-d141-4900-a2ca-d31acf654244 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:25.902922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f260db7-d141-4900-a2ca-d31acf654244 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:25.903205 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f260db7-d141-4900-a2ca-d31acf654244 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:25.903295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8695e5a-c762-443d-a0da-fde35833df66 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:25.903955 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f260db7-d141-4900-a2ca-d31acf654244 None admin] RBAC: Adding query filter params (name=member) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:25.904307 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f260db7-d141-4900-a2ca-d31acf654244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:25.905727 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f260db7-d141-4900-a2ca-d31acf654244 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:25.914476 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 35/73] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:25.915544 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a6593-293a-4476-a4b3-8dcff78d21bd None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:25.915841 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a6593-293a-4476-a4b3-8dcff78d21bd None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:25.916156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a6593-293a-4476-a4b3-8dcff78d21bd None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:25.917392 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 36/74] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:25.917392 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a6593-293a-4476-a4b3-8dcff78d21bd None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:25.940898 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4e133-f747-4cf5-9272-a17de77a7326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:25.941561 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4e133-f747-4cf5-9272-a17de77a7326 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:25.941849 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4e133-f747-4cf5-9272-a17de77a7326 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:25.942128 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4e133-f747-4cf5-9272-a17de77a7326 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:25.942872 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4e133-f747-4cf5-9272-a17de77a7326 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:25.943182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4e133-f747-4cf5-9272-a17de77a7326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:25.944611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4e133-f747-4cf5-9272-a17de77a7326 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:25.952610 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 39/75] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:25.953845 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e680e-2eee-4bc6-bbb6-f35bbac307e5 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:25.954141 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e680e-2eee-4bc6-bbb6-f35bbac307e5 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:25.954421 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e680e-2eee-4bc6-bbb6-f35bbac307e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:25.970433 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-bb2e680e-2eee-4bc6-bbb6-f35bbac307e5 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:25.971616 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-bb2e680e-2eee-4bc6-bbb6-f35bbac307e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:26.017736 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a6593-293a-4476-a4b3-8dcff78d21bd None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:26.034539 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 40/76] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:26.035463 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e680e-2eee-4bc6-bbb6-f35bbac307e5 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:26.052432 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adab2e2-abb0-4cb8-b60f-bf455c65e9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:26.053499 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adab2e2-abb0-4cb8-b60f-bf455c65e9cc None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:26.053784 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adab2e2-abb0-4cb8-b60f-bf455c65e9cc None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:26.054069 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adab2e2-abb0-4cb8-b60f-bf455c65e9cc None admin] PATH_INFO: `/v3/users/e1895d390d79461cb033f7ffd725f75e` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:26.068691 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adab2e2-abb0-4cb8-b60f-bf455c65e9cc None admin] RBAC: Authorizing `identity:get_user(user_id=e1895d390d79461cb033f7ffd725f75e)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:26.070148 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adab2e2-abb0-4cb8-b60f-bf455c65e9cc None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:26.071810 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 37/77] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:25 2022] GET /identity/v3/users/e1895d390d79461cb033f7ffd725f75e => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:26.073011 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa96d9-8f30-4e6f-b73a-abbd4dc310c0 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:26.073554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa96d9-8f30-4e6f-b73a-abbd4dc310c0 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:26.073830 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa96d9-8f30-4e6f-b73a-abbd4dc310c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:26.091327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-48aa96d9-8f30-4e6f-b73a-abbd4dc310c0 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:26.092557 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-48aa96d9-8f30-4e6f-b73a-abbd4dc310c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:26.130118 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e680e-2eee-4bc6-bbb6-f35bbac307e5 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:26.156551 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 38/78] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:26.158095 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa96d9-8f30-4e6f-b73a-abbd4dc310c0 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:26.163020 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c37f92-d73f-429a-ba35-74bfb00db5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:26.163974 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c37f92-d73f-429a-ba35-74bfb00db5a0 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:26.164313 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c37f92-d73f-429a-ba35-74bfb00db5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:26.164595 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c37f92-d73f-429a-ba35-74bfb00db5a0 None admin] PATH_INFO: `/v3/users/e1895d390d79461cb033f7ffd725f75e` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:26.165804 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c37f92-d73f-429a-ba35-74bfb00db5a0 None admin] RBAC: Authorizing `identity:get_user(user_id=e1895d390d79461cb033f7ffd725f75e)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:26.167266 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c37f92-d73f-429a-ba35-74bfb00db5a0 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:26.169076 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 41/79] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:26 2022] GET /identity/v3/users/e1895d390d79461cb033f7ffd725f75e => generated 275 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:26.169743 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c37f92-d73f-429a-ba35-74bfb00db5a0 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:26.257227 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa96d9-8f30-4e6f-b73a-abbd4dc310c0 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:26.263732 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c37f92-d73f-429a-ba35-74bfb00db5a0 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:26.288527 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87729c-0870-489d-891a-5b6e36bf8bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:26.289401 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87729c-0870-489d-891a-5b6e36bf8bc9 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:26.289687 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87729c-0870-489d-891a-5b6e36bf8bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:26.289963 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87729c-0870-489d-891a-5b6e36bf8bc9 None admin] PATH_INFO: `/v3/users/01d461fea7474f0cabc39359a0a27117` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:26.291809 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87729c-0870-489d-891a-5b6e36bf8bc9 None admin] RBAC: Authorizing `identity:get_user(user_id=01d461fea7474f0cabc39359a0a27117)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:26.293309 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87729c-0870-489d-891a-5b6e36bf8bc9 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:26.294941 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 39/80] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:26 2022] GET /identity/v3/users/01d461fea7474f0cabc39359a0a27117 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:26.295706 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87729c-0870-489d-891a-5b6e36bf8bc9 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:26.298952 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bff069-aad3-4bca-a0a5-2e0533d93656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:26.299930 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bff069-aad3-4bca-a0a5-2e0533d93656 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:26.300037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bff069-aad3-4bca-a0a5-2e0533d93656 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:26.300303 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bff069-aad3-4bca-a0a5-2e0533d93656 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:26.310349 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bff069-aad3-4bca-a0a5-2e0533d93656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:26.318740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-a6bff069-aad3-4bca-a0a5-2e0533d93656 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:26.318740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:26.318740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:26.318740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:26.318740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:26.318740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:26.318740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:26.318740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:26.318740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:26.318740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:26.318740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:26.318740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:26.318740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:26.318740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:26.318740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:26.318740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:26.319891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:26.319891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:26.319891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:26.319891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:26.319891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:26.319891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:26.319891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:26.319891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:26.319891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:26.319891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:26.319891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:26.319891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:26.319891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:26.319891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:26.319891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:26.319891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:26.325672 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:26.325672 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:26.325672 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:26.325672 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:26.325672 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:26.325672 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:26.325672 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:26.325672 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:26.325672 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:26.325672 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:26.325672 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:26.325672 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:26.325672 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 42/81] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:26.325672 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bff069-aad3-4bca-a0a5-2e0533d93656 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:26.397499 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87729c-0870-489d-891a-5b6e36bf8bc9 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:26.413783 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bff069-aad3-4bca-a0a5-2e0533d93656 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:26.429641 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a79a7-6122-44b3-8a3b-fdbc5c76e1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:26.430291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a79a7-6122-44b3-8a3b-fdbc5c76e1e2 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:26.430578 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a79a7-6122-44b3-8a3b-fdbc5c76e1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:26.430858 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a79a7-6122-44b3-8a3b-fdbc5c76e1e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:26.445370 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346795f-1e6f-4eca-a9b7-b502865819f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:26.446005 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346795f-1e6f-4eca-a9b7-b502865819f4 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:26.446288 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346795f-1e6f-4eca-a9b7-b502865819f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:26.446587 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346795f-1e6f-4eca-a9b7-b502865819f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:26.494194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a79a7-6122-44b3-8a3b-fdbc5c76e1e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:26.495670 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a79a7-6122-44b3-8a3b-fdbc5c76e1e2 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:26.509628 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346795f-1e6f-4eca-a9b7-b502865819f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:26.511077 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346795f-1e6f-4eca-a9b7-b502865819f4 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:26.590021 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 40/82] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:43:26.591064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a79a7-6122-44b3-8a3b-fdbc5c76e1e2 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:26.606008 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 43/83] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:43:26.606855 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346795f-1e6f-4eca-a9b7-b502865819f4 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:26.686604 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a79a7-6122-44b3-8a3b-fdbc5c76e1e2 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:26.706861 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346795f-1e6f-4eca-a9b7-b502865819f4 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:26.719457 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31437bf2-91a7-4903-acf3-c973b7c8ee66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:26.720308 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31437bf2-91a7-4903-acf3-c973b7c8ee66 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:26.720587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31437bf2-91a7-4903-acf3-c973b7c8ee66 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:26.720862 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31437bf2-91a7-4903-acf3-c973b7c8ee66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:26.722041 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31437bf2-91a7-4903-acf3-c973b7c8ee66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:26.723525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31437bf2-91a7-4903-acf3-c973b7c8ee66 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:26.725178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 41/84] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:43:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:26.728705 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31437bf2-91a7-4903-acf3-c973b7c8ee66 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:26.739814 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb843582-77b7-4d2b-8834-a37236e4d4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:26.740496 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb843582-77b7-4d2b-8834-a37236e4d4c4 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:26.740784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb843582-77b7-4d2b-8834-a37236e4d4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:26.741063 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb843582-77b7-4d2b-8834-a37236e4d4c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:26.806627 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb843582-77b7-4d2b-8834-a37236e4d4c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:26.808144 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb843582-77b7-4d2b-8834-a37236e4d4c4 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:26.823314 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31437bf2-91a7-4903-acf3-c973b7c8ee66 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:26.854670 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb2bbc-fd74-4da4-8f0f-9802348c53ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:26.855264 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb2bbc-fd74-4da4-8f0f-9802348c53ad None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:26.855549 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb2bbc-fd74-4da4-8f0f-9802348c53ad None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:26.855826 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb2bbc-fd74-4da4-8f0f-9802348c53ad None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:26.856607 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb2bbc-fd74-4da4-8f0f-9802348c53ad None admin] RBAC: Adding query filter params (name=member) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:26.856914 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb2bbc-fd74-4da4-8f0f-9802348c53ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:26.858308 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb2bbc-fd74-4da4-8f0f-9802348c53ad None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:26.866587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 42/85] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:26.871101 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb2bbc-fd74-4da4-8f0f-9802348c53ad None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:26.902681 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 44/86] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:43:26.904647 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb843582-77b7-4d2b-8834-a37236e4d4c4 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:26.960550 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb2bbc-fd74-4da4-8f0f-9802348c53ad None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:26.991850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccbead-6bff-4511-9ec8-3478c2c0b9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:26.992720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccbead-6bff-4511-9ec8-3478c2c0b9dc None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:26.993003 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccbead-6bff-4511-9ec8-3478c2c0b9dc None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:26.993278 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccbead-6bff-4511-9ec8-3478c2c0b9dc None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:26.994467 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccbead-6bff-4511-9ec8-3478c2c0b9dc None admin] RBAC: Authorizing `identity:get_project(project_id=5f507bcdfd314874b0a378d7037ed855)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:26.995933 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccbead-6bff-4511-9ec8-3478c2c0b9dc None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:26.996486 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb843582-77b7-4d2b-8834-a37236e4d4c4 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:26.997644 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 43/87] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:26 2022] GET /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855 => generated 298 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:26.998380 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccbead-6bff-4511-9ec8-3478c2c0b9dc None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:27.033931 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d42fd-efa4-43e4-81fc-93930fe45d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:27.034802 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d42fd-efa4-43e4-81fc-93930fe45d16 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:27.035094 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d42fd-efa4-43e4-81fc-93930fe45d16 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:27.035369 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d42fd-efa4-43e4-81fc-93930fe45d16 None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:27.036608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d42fd-efa4-43e4-81fc-93930fe45d16 None admin] RBAC: Authorizing `identity:get_project(project_id=5f507bcdfd314874b0a378d7037ed855)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:27.038073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d42fd-efa4-43e4-81fc-93930fe45d16 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:27.039778 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 45/88] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:26 2022] GET /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:27.040679 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d42fd-efa4-43e4-81fc-93930fe45d16 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:27.091171 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccbead-6bff-4511-9ec8-3478c2c0b9dc None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:27.122613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1e7cf-9e28-4de4-b70d-44310ab77044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:27.123208 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1e7cf-9e28-4de4-b70d-44310ab77044 None admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:27.123492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1e7cf-9e28-4de4-b70d-44310ab77044 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:27.123766 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1e7cf-9e28-4de4-b70d-44310ab77044 None admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:27.124495 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1e7cf-9e28-4de4-b70d-44310ab77044 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:27.126482 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1e7cf-9e28-4de4-b70d-44310ab77044 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:27.134111 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d42fd-efa4-43e4-81fc-93930fe45d16 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:27.166389 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1950ffe-6993-4aca-b506-634c324ba0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:27.167252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1950ffe-6993-4aca-b506-634c324ba0df None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:27.167540 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1950ffe-6993-4aca-b506-634c324ba0df None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:27.167818 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1950ffe-6993-4aca-b506-634c324ba0df None admin] PATH_INFO: `/v3/users/e1895d390d79461cb033f7ffd725f75e` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:27.169039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1950ffe-6993-4aca-b506-634c324ba0df None admin] RBAC: Authorizing `identity:get_user(user_id=e1895d390d79461cb033f7ffd725f75e)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:27.170545 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1950ffe-6993-4aca-b506-634c324ba0df None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:27.176879 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 46/89] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:27 2022] GET /identity/v3/users/e1895d390d79461cb033f7ffd725f75e => generated 275 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:27.176879 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1950ffe-6993-4aca-b506-634c324ba0df None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:27.232078 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 44/90] 10.222.0.18 () {60 vars in 1132 bytes} [Mon May 2 08:43:26 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:43:27.232078 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1e7cf-9e28-4de4-b70d-44310ab77044 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:27.276582 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1950ffe-6993-4aca-b506-634c324ba0df None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:27.315152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbebfe-4ee6-44ed-bb48-1e3bbb6b4099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:27.316597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbebfe-4ee6-44ed-bb48-1e3bbb6b4099 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:27.316951 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbebfe-4ee6-44ed-bb48-1e3bbb6b4099 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:27.317242 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbebfe-4ee6-44ed-bb48-1e3bbb6b4099 None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:27.318538 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbebfe-4ee6-44ed-bb48-1e3bbb6b4099 None admin] RBAC: Authorizing `identity:get_project(project_id=5f507bcdfd314874b0a378d7037ed855)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:27.320094 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbebfe-4ee6-44ed-bb48-1e3bbb6b4099 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:27.321924 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 47/91] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:27 2022] GET /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:27.322729 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbebfe-4ee6-44ed-bb48-1e3bbb6b4099 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:27.334401 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1e7cf-9e28-4de4-b70d-44310ab77044 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:27.373487 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97d4de-cf6a-4f01-bbf3-b358585c113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:27.374195 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97d4de-cf6a-4f01-bbf3-b358585c113a None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:27.374548 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97d4de-cf6a-4f01-bbf3-b358585c113a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:27.374847 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97d4de-cf6a-4f01-bbf3-b358585c113a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:27.376505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97d4de-cf6a-4f01-bbf3-b358585c113a None admin] RBAC: Adding query filter params (role.id=b860fb30a96b4b2ea790453a2a4f6044, scope.project.id=5f507bcdfd314874b0a378d7037ed855, user.id=e1895d390d79461cb033f7ffd725f75e) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:27.376878 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97d4de-cf6a-4f01-bbf3-b358585c113a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:27.378403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97d4de-cf6a-4f01-bbf3-b358585c113a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:27.385343 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 45/92] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:43:27 2022] GET /identity/v3/role_assignments?user.id=e1895d390d79461cb033f7ffd725f75e&scope.project.id=5f507bcdfd314874b0a378d7037ed855&role.id=b860fb30a96b4b2ea790453a2a4f6044 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:27.386212 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97d4de-cf6a-4f01-bbf3-b358585c113a None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:27.447148 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbebfe-4ee6-44ed-bb48-1e3bbb6b4099 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:27.492239 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd25469-9753-4959-af2d-36ebd0a90285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:27.492239 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd25469-9753-4959-af2d-36ebd0a90285 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:27.492239 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd25469-9753-4959-af2d-36ebd0a90285 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:27.492553 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd25469-9753-4959-af2d-36ebd0a90285 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:27.493343 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd25469-9753-4959-af2d-36ebd0a90285 None admin] RBAC: Adding query filter params (role.id=722968fb4ca44c1795d61c44f61a78d9, scope.project.id=5f507bcdfd314874b0a378d7037ed855, user.id=e1895d390d79461cb033f7ffd725f75e) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:27.493664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd25469-9753-4959-af2d-36ebd0a90285 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:27.495207 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd25469-9753-4959-af2d-36ebd0a90285 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:27.504764 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 48/93] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:43:27 2022] GET /identity/v3/role_assignments?user.id=e1895d390d79461cb033f7ffd725f75e&scope.project.id=5f507bcdfd314874b0a378d7037ed855&role.id=722968fb4ca44c1795d61c44f61a78d9 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:27.505793 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd25469-9753-4959-af2d-36ebd0a90285 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:27.527358 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97d4de-cf6a-4f01-bbf3-b358585c113a None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:27.572966 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417274-36b7-4f29-b44e-3de0aebc0afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:27.574315 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417274-36b7-4f29-b44e-3de0aebc0afe None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:27.574846 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417274-36b7-4f29-b44e-3de0aebc0afe None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:27.575326 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417274-36b7-4f29-b44e-3de0aebc0afe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:27.621416 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd25469-9753-4959-af2d-36ebd0a90285 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:27.666601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06947808-0c75-497e-9f99-88ac331d6262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:27.667359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06947808-0c75-497e-9f99-88ac331d6262 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:27.667648 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06947808-0c75-497e-9f99-88ac331d6262 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:27.667926 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06947808-0c75-497e-9f99-88ac331d6262 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:27.668806 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06947808-0c75-497e-9f99-88ac331d6262 None admin] RBAC: Adding query filter params (role.id=509216a314244b96b05d3fe56b0d9cd1, scope.project.id=5f507bcdfd314874b0a378d7037ed855, user.id=01d461fea7474f0cabc39359a0a27117) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:27.669123 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06947808-0c75-497e-9f99-88ac331d6262 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:27.669220 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae417274-36b7-4f29-b44e-3de0aebc0afe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:27.670622 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06947808-0c75-497e-9f99-88ac331d6262 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:27.670732 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae417274-36b7-4f29-b44e-3de0aebc0afe None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:27.676972 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 49/94] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:43:27 2022] GET /identity/v3/role_assignments?user.id=01d461fea7474f0cabc39359a0a27117&scope.project.id=5f507bcdfd314874b0a378d7037ed855&role.id=509216a314244b96b05d3fe56b0d9cd1 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:27.797276 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 46/95] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:43:27.803259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06947808-0c75-497e-9f99-88ac331d6262 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:27.930539 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06947808-0c75-497e-9f99-88ac331d6262 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:27.965028 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2142e-5363-4777-9bc4-df66ea35bb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:27.965892 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2142e-5363-4777-9bc4-df66ea35bb7e None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:27.966173 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2142e-5363-4777-9bc4-df66ea35bb7e None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:27.966447 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2142e-5363-4777-9bc4-df66ea35bb7e None admin] PATH_INFO: `/v3/projects/dd6b9d6b7d7642479c074d032be2110b` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:27.967646 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2142e-5363-4777-9bc4-df66ea35bb7e None admin] RBAC: Authorizing `identity:get_project(project_id=dd6b9d6b7d7642479c074d032be2110b)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:27.969698 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2142e-5363-4777-9bc4-df66ea35bb7e None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:27.971398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 50/96] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:27 2022] GET /identity/v3/projects/dd6b9d6b7d7642479c074d032be2110b => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:27.981162 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417274-36b7-4f29-b44e-3de0aebc0afe None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:28.135356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417274-36b7-4f29-b44e-3de0aebc0afe None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:28.181816 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d22d27-3779-4051-9ea9-025e5ffd2f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:28.182402 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d22d27-3779-4051-9ea9-025e5ffd2f84 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:28.182689 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d22d27-3779-4051-9ea9-025e5ffd2f84 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:28.182968 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d22d27-3779-4051-9ea9-025e5ffd2f84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:28.183802 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d22d27-3779-4051-9ea9-025e5ffd2f84 None admin] RBAC: Adding query filter params (role.id=722968fb4ca44c1795d61c44f61a78d9, scope.project.id=dd6b9d6b7d7642479c074d032be2110b, user.id=e1895d390d79461cb033f7ffd725f75e) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:28.184153 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d22d27-3779-4051-9ea9-025e5ffd2f84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:28.185611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d22d27-3779-4051-9ea9-025e5ffd2f84 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:28.196077 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 47/97] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:43:27 2022] GET /identity/v3/role_assignments?user.id=e1895d390d79461cb033f7ffd725f75e&scope.project.id=dd6b9d6b7d7642479c074d032be2110b&role.id=722968fb4ca44c1795d61c44f61a78d9 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:30.683204 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713064-1256-4718-8d1d-c1707138fe24 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:30.683784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713064-1256-4718-8d1d-c1707138fe24 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:30.683784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713064-1256-4718-8d1d-c1707138fe24 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:30.685143 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 51/98] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:30.688903 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fbb06-16d1-44e4-baf6-854e91837f77 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:30.690702 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522110b-b03e-404f-879f-2ee5b199cee0 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:30.691162 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522110b-b03e-404f-879f-2ee5b199cee0 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:30.691600 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522110b-b03e-404f-879f-2ee5b199cee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:30.692061 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fbb06-16d1-44e4-baf6-854e91837f77 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:30.693852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fbb06-16d1-44e4-baf6-854e91837f77 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:30.695431 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 48/99] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:30.701628 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb543ee-a1ff-4299-b4bf-686450fa97ef None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:30.703199 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb543ee-a1ff-4299-b4bf-686450fa97ef None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:30.705611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb543ee-a1ff-4299-b4bf-686450fa97ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:30.730305 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-e522110b-b03e-404f-879f-2ee5b199cee0 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:30.734613 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-e522110b-b03e-404f-879f-2ee5b199cee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:30.737975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-8cb543ee-a1ff-4299-b4bf-686450fa97ef None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:30.739319 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-8cb543ee-a1ff-4299-b4bf-686450fa97ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:30.859434 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 52/100] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:30.859794 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 49/101] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:30.861392 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b66aac-7e81-41dd-986e-6148f16d8110 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:30.861931 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b66aac-7e81-41dd-986e-6148f16d8110 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:30.862444 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b66aac-7e81-41dd-986e-6148f16d8110 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:30.863924 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 53/102] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:30.868127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1222252-2440-41d0-a7e7-4f9010528fb3 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:30.868646 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1222252-2440-41d0-a7e7-4f9010528fb3 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:30.869137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1222252-2440-41d0-a7e7-4f9010528fb3 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:30.870652 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 50/103] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:30.877728 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3376936-b6f3-43df-8183-555ce9b192d7 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:30.878301 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3376936-b6f3-43df-8183-555ce9b192d7 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:30.878794 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3376936-b6f3-43df-8183-555ce9b192d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:30.881469 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ba2cb-b481-4068-a7f2-9854852b1d74 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:30.881856 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ba2cb-b481-4068-a7f2-9854852b1d74 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:30.882149 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ba2cb-b481-4068-a7f2-9854852b1d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:30.901818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-6a7ba2cb-b481-4068-a7f2-9854852b1d74 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:30.903347 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-6a7ba2cb-b481-4068-a7f2-9854852b1d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:30.906144 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-b3376936-b6f3-43df-8183-555ce9b192d7 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:30.907751 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-b3376936-b6f3-43df-8183-555ce9b192d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:30.979504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 51/104] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:30.984616 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ba2cb-b481-4068-a7f2-9854852b1d74 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:30.997052 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 54/105] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:30.998019 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3376936-b6f3-43df-8183-555ce9b192d7 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:31.114566 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3376936-b6f3-43df-8183-555ce9b192d7 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:31.127363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ba2cb-b481-4068-a7f2-9854852b1d74 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:31.149891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66fe6c-da09-4287-9483-83d71b6957cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:31.150988 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66fe6c-da09-4287-9483-83d71b6957cd None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:31.151449 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66fe6c-da09-4287-9483-83d71b6957cd None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:31.151879 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66fe6c-da09-4287-9483-83d71b6957cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:31.153587 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66fe6c-da09-4287-9483-83d71b6957cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:31.155333 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66fe6c-da09-4287-9483-83d71b6957cd None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:31.157975 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 55/106] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:43:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:31.163590 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66fe6c-da09-4287-9483-83d71b6957cd None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:31.171605 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcd2bd-a93c-4703-b875-d89341f403b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:31.172547 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcd2bd-a93c-4703-b875-d89341f403b9 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:31.172838 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcd2bd-a93c-4703-b875-d89341f403b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:31.173121 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcd2bd-a93c-4703-b875-d89341f403b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:31.188319 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bcd2bd-a93c-4703-b875-d89341f403b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:31.199864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-b5bcd2bd-a93c-4703-b875-d89341f403b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:43:31.199864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:31.199864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:31.199864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:31.199864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:31.199864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:31.199864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:31.199864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:31.199864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:31.199864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:31.199864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:31.199864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:31.199864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:31.199864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:31.199864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:31.199864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:31.200850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:31.200850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:31.200850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:31.200850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:31.200850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:31.200850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:31.200850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:31.200850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:31.200850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:31.200850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:31.200850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:31.200850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:43:31.200850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:31.200850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:31.200850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:31.200850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:31.201729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:31.201729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:31.201729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:31.201729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:31.201729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:31.201729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:31.201729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:31.201729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:31.201729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:31.201729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:31.201729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:43:31.201729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:43:31.201729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 52/107] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:43:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:31.202373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcd2bd-a93c-4703-b875-d89341f403b9 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:31.274764 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66fe6c-da09-4287-9483-83d71b6957cd None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:31.311340 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb0fd4-737f-4a01-ad5d-bf4ed732b28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:31.312430 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb0fd4-737f-4a01-ad5d-bf4ed732b28d None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:31.312965 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb0fd4-737f-4a01-ad5d-bf4ed732b28d None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:31.313504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb0fd4-737f-4a01-ad5d-bf4ed732b28d None admin] PATH_INFO: `/v3/roles/member` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:31.324161 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb0fd4-737f-4a01-ad5d-bf4ed732b28d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:31.325793 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcd2bd-a93c-4703-b875-d89341f403b9 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:31.332846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-9ddb0fd4-737f-4a01-ad5d-bf4ed732b28d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:31.332846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:31.332846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:31.332846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:31.332846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:31.332846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:31.332846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:31.332846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:31.332846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:31.332846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:31.332846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:31.332846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:31.332846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:31.332846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:31.332846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:31.332846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:31.333950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:31.333950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:31.333950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:31.333950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:31.333950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:31.333950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:31.333950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:31.333950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:31.333950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:31.333950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:31.333950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:31.333950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:31.333950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:31.333950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:31.333950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:31.333950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:31.334742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:31.334742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:31.334742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:31.334742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:31.334742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:31.334742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:31.334742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:31.334742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:31.334742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:31.334742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:31.334742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:31.334742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:31.336660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 56/108] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:31.337661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb0fd4-737f-4a01-ad5d-bf4ed732b28d None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:31.362401 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82927e6-9250-4a24-9e15-713a066cf87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:31.363208 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82927e6-9250-4a24-9e15-713a066cf87e None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:31.363501 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82927e6-9250-4a24-9e15-713a066cf87e None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:31.363785 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82927e6-9250-4a24-9e15-713a066cf87e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:31.374182 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82927e6-9250-4a24-9e15-713a066cf87e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:31.382455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-a82927e6-9250-4a24-9e15-713a066cf87e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:43:31.382455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:31.382455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:31.382455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:31.382455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:31.382455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:31.382455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:31.382455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:31.382455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:31.382455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:31.382455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:31.382455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:31.382455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:31.382455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:31.382455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:31.382455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:31.383351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:31.383351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:31.383351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:31.383351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:31.383351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:31.383351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:31.383351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:31.383351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:31.383351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:31.383351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:31.383351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:31.383351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:43:31.383351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:31.383351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:31.383351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:31.383351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:31.384134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:31.384134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:31.384134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:31.384134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:31.384134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:31.384134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:31.384134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:31.384134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:31.384134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:31.384134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:31.384134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:43:31.384134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:43:31.384134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 53/109] 10.222.0.18 () {56 vars in 1096 bytes} [Mon May 2 08:43:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:31.384770 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82927e6-9250-4a24-9e15-713a066cf87e None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:31.444566 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb0fd4-737f-4a01-ad5d-bf4ed732b28d None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:31.478204 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e7827-7791-4c25-ac29-7f1e0d2e25e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:31.478870 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e7827-7791-4c25-ac29-7f1e0d2e25e9 None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:31.479157 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e7827-7791-4c25-ac29-7f1e0d2e25e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:31.479435 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e7827-7791-4c25-ac29-7f1e0d2e25e9 None admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:31.480172 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e7827-7791-4c25-ac29-7f1e0d2e25e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:31.481642 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e7827-7791-4c25-ac29-7f1e0d2e25e9 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:31.483282 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82927e6-9250-4a24-9e15-713a066cf87e None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:31.517089 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9e844-6ce0-4f33-a467-aff31a492824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:31.520163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9e844-6ce0-4f33-a467-aff31a492824 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:31.520163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9e844-6ce0-4f33-a467-aff31a492824 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:31.520163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9e844-6ce0-4f33-a467-aff31a492824 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:31.520163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9e844-6ce0-4f33-a467-aff31a492824 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:31.520163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9e844-6ce0-4f33-a467-aff31a492824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:31.520873 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9e844-6ce0-4f33-a467-aff31a492824 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:31.528611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 54/110] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:43:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:31.530040 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9e844-6ce0-4f33-a467-aff31a492824 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:31.584172 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 57/111] 10.222.0.18 () {60 vars in 1141 bytes} [Mon May 2 08:43:31 2022] POST /identity/v3/projects => generated 302 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:43:31.586186 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b6507-88a4-4905-a4f5-6ac5a79fa62f None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:31.586501 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b6507-88a4-4905-a4f5-6ac5a79fa62f None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:31.586786 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b6507-88a4-4905-a4f5-6ac5a79fa62f None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:31.593552 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 58/112] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:31.593552 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b6507-88a4-4905-a4f5-6ac5a79fa62f None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:31.651904 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9e844-6ce0-4f33-a467-aff31a492824 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:31.706535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fb280-dca0-4b0b-afd7-411542c7f3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:31.707295 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fb280-dca0-4b0b-afd7-411542c7f3c2 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:31.707564 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fb280-dca0-4b0b-afd7-411542c7f3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:31.707903 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fb280-dca0-4b0b-afd7-411542c7f3c2 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:31.708696 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fb280-dca0-4b0b-afd7-411542c7f3c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:31.709009 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fb280-dca0-4b0b-afd7-411542c7f3c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:31.710452 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fb280-dca0-4b0b-afd7-411542c7f3c2 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:31.725394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 55/113] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:31.726447 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fb280-dca0-4b0b-afd7-411542c7f3c2 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:31.742969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b6507-88a4-4905-a4f5-6ac5a79fa62f None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:31.782664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460f5da-7938-4ae7-b1cb-2a2602fd5af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:31.783630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460f5da-7938-4ae7-b1cb-2a2602fd5af3 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:31.784144 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460f5da-7938-4ae7-b1cb-2a2602fd5af3 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:31.785124 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460f5da-7938-4ae7-b1cb-2a2602fd5af3 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:31.786431 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460f5da-7938-4ae7-b1cb-2a2602fd5af3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:31.786946 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460f5da-7938-4ae7-b1cb-2a2602fd5af3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:31.789311 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460f5da-7938-4ae7-b1cb-2a2602fd5af3 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:31.801271 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 59/114] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:31.803283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39657ee5-83f3-4b48-82bd-b416d71f7676 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:31.804554 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39657ee5-83f3-4b48-82bd-b416d71f7676 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:31.804554 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39657ee5-83f3-4b48-82bd-b416d71f7676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:31.829671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-39657ee5-83f3-4b48-82bd-b416d71f7676 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:31.831269 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-39657ee5-83f3-4b48-82bd-b416d71f7676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:31.842272 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fb280-dca0-4b0b-afd7-411542c7f3c2 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:31.886672 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aac76c-5ddd-4df8-9b9e-d4495bd53784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:31.887593 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aac76c-5ddd-4df8-9b9e-d4495bd53784 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:31.887878 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aac76c-5ddd-4df8-9b9e-d4495bd53784 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:31.888205 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aac76c-5ddd-4df8-9b9e-d4495bd53784 None admin] PATH_INFO: `/v3/users/e1895d390d79461cb033f7ffd725f75e` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:31.889831 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aac76c-5ddd-4df8-9b9e-d4495bd53784 None admin] RBAC: Authorizing `identity:get_user(user_id=e1895d390d79461cb033f7ffd725f75e)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:31.892033 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aac76c-5ddd-4df8-9b9e-d4495bd53784 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:31.894473 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 56/115] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:31 2022] GET /identity/v3/users/e1895d390d79461cb033f7ffd725f75e => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:31.895342 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aac76c-5ddd-4df8-9b9e-d4495bd53784 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:31.916341 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 60/116] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:31.924302 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39657ee5-83f3-4b48-82bd-b416d71f7676 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:32.003277 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aac76c-5ddd-4df8-9b9e-d4495bd53784 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:32.025839 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39657ee5-83f3-4b48-82bd-b416d71f7676 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:32.036904 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3745c89-f06f-4bbe-993e-373959dfe8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:32.037730 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3745c89-f06f-4bbe-993e-373959dfe8e8 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:32.038006 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3745c89-f06f-4bbe-993e-373959dfe8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:32.038283 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3745c89-f06f-4bbe-993e-373959dfe8e8 None admin] PATH_INFO: `/v3/users/e1895d390d79461cb033f7ffd725f75e` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:32.039485 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3745c89-f06f-4bbe-993e-373959dfe8e8 None admin] RBAC: Authorizing `identity:get_user(user_id=e1895d390d79461cb033f7ffd725f75e)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:32.040988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3745c89-f06f-4bbe-993e-373959dfe8e8 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:32.042614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 57/117] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:31 2022] GET /identity/v3/users/e1895d390d79461cb033f7ffd725f75e => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:32.043780 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e79fc-696f-4061-8838-6a85d2671745 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:32.044088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e79fc-696f-4061-8838-6a85d2671745 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:32.044367 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e79fc-696f-4061-8838-6a85d2671745 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:32.045645 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 58/118] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:32.048875 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e79fc-696f-4061-8838-6a85d2671745 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:32.066576 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30246193-d364-40d7-8605-2de91edd0a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:32.067463 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30246193-d364-40d7-8605-2de91edd0a7d None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:32.067733 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30246193-d364-40d7-8605-2de91edd0a7d None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:32.068007 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30246193-d364-40d7-8605-2de91edd0a7d None admin] PATH_INFO: `/v3/users/01d461fea7474f0cabc39359a0a27117` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:32.069483 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30246193-d364-40d7-8605-2de91edd0a7d None admin] RBAC: Authorizing `identity:get_user(user_id=01d461fea7474f0cabc39359a0a27117)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:32.070957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30246193-d364-40d7-8605-2de91edd0a7d None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:32.072621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 61/119] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:31 2022] GET /identity/v3/users/01d461fea7474f0cabc39359a0a27117 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:32.077500 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30246193-d364-40d7-8605-2de91edd0a7d None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:32.155040 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e79fc-696f-4061-8838-6a85d2671745 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:32.171596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30246193-d364-40d7-8605-2de91edd0a7d None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:32.187931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384f563-ca04-4006-adbe-fab3d0483716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:32.188902 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384f563-ca04-4006-adbe-fab3d0483716 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:32.189184 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384f563-ca04-4006-adbe-fab3d0483716 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:32.189457 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384f563-ca04-4006-adbe-fab3d0483716 None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:32.190632 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384f563-ca04-4006-adbe-fab3d0483716 None admin] RBAC: Authorizing `identity:get_project(project_id=5f507bcdfd314874b0a378d7037ed855)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:32.192149 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384f563-ca04-4006-adbe-fab3d0483716 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:32.193825 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 59/120] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:32 2022] GET /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:32.198724 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384f563-ca04-4006-adbe-fab3d0483716 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:32.210846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013e4e2-c03b-4dec-9538-c2021e4ba10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:32.211693 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013e4e2-c03b-4dec-9538-c2021e4ba10c None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:32.211985 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013e4e2-c03b-4dec-9538-c2021e4ba10c None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:32.212336 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013e4e2-c03b-4dec-9538-c2021e4ba10c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:32.222448 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013e4e2-c03b-4dec-9538-c2021e4ba10c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:32.230152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-4013e4e2-c03b-4dec-9538-c2021e4ba10c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 02 08:43:32.230152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:32.230152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:32.230152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:32.230152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:32.230152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:32.230152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:32.230152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:32.230152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:32.230152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:32.230152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:32.230152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:32.230152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:32.230152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:32.230152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:32.230152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:32.231004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:32.231004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:32.231004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:32.231004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:32.231004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:32.231004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:32.231004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:32.231004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:32.231004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:32.231004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:32.231004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:32.231004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:32.231004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:32.231004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:32.231004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:32.231004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:32.231777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:32.231777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:32.231777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:32.231777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:32.231777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:32.231777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:32.231777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:32.231777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:32.231777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:32.231777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:32.231777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 02 08:43:32.231777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:32.231777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 62/121] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:32.233219 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd1378-104b-4c8a-96e9-ed8c8fb57152 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:32.236381 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd1378-104b-4c8a-96e9-ed8c8fb57152 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:32.237132 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd1378-104b-4c8a-96e9-ed8c8fb57152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:32.257502 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-5bdd1378-104b-4c8a-96e9-ed8c8fb57152 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:32.259005 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-5bdd1378-104b-4c8a-96e9-ed8c8fb57152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:32.291176 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384f563-ca04-4006-adbe-fab3d0483716 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:32.325132 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d5994-0e31-430c-9f16-8668e10b7b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:32.326004 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d5994-0e31-430c-9f16-8668e10b7b1e None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:32.326286 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d5994-0e31-430c-9f16-8668e10b7b1e None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:32.326562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d5994-0e31-430c-9f16-8668e10b7b1e None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:32.326835 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 63/122] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:32.328066 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d5994-0e31-430c-9f16-8668e10b7b1e None admin] RBAC: Authorizing `identity:get_project(project_id=5f507bcdfd314874b0a378d7037ed855)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:32.329693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d5994-0e31-430c-9f16-8668e10b7b1e None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:32.336027 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 60/123] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:32 2022] GET /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:32.336027 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d5994-0e31-430c-9f16-8668e10b7b1e None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:32.337004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd1378-104b-4c8a-96e9-ed8c8fb57152 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:32.436304 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d5994-0e31-430c-9f16-8668e10b7b1e None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:32.443180 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd1378-104b-4c8a-96e9-ed8c8fb57152 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:32.472072 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583d4ac-b43a-41d3-a4f0-21d6704522c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:32.472996 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583d4ac-b43a-41d3-a4f0-21d6704522c0 None admin] REQUEST_METHOD: `PUT` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:32.473449 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583d4ac-b43a-41d3-a4f0-21d6704522c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:32.473736 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583d4ac-b43a-41d3-a4f0-21d6704522c0 None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855/users/e1895d390d79461cb033f7ffd725f75e/roles/b860fb30a96b4b2ea790453a2a4f6044` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:32.476096 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583d4ac-b43a-41d3-a4f0-21d6704522c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f507bcdfd314874b0a378d7037ed855, user_id=e1895d390d79461cb033f7ffd725f75e, role_id=b860fb30a96b4b2ea790453a2a4f6044)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:32.477567 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583d4ac-b43a-41d3-a4f0-21d6704522c0 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:32.479378 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fe7a3-7eab-4a61-9c02-d98e97cb05bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:32.480510 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fe7a3-7eab-4a61-9c02-d98e97cb05bd None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:32.480906 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fe7a3-7eab-4a61-9c02-d98e97cb05bd None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:32.481295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fe7a3-7eab-4a61-9c02-d98e97cb05bd None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:32.482498 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fe7a3-7eab-4a61-9c02-d98e97cb05bd None admin] RBAC: Authorizing `identity:get_project(project_id=5f507bcdfd314874b0a378d7037ed855)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:32.483951 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fe7a3-7eab-4a61-9c02-d98e97cb05bd None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:32.485756 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 64/124] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:32 2022] GET /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:32.486545 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fe7a3-7eab-4a61-9c02-d98e97cb05bd None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:32.551958 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 61/125] 10.222.0.18 () {58 vars in 1439 bytes} [Mon May 2 08:43:32 2022] PUT /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855/users/e1895d390d79461cb033f7ffd725f75e/roles/b860fb30a96b4b2ea790453a2a4f6044 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:43:32.553005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583d4ac-b43a-41d3-a4f0-21d6704522c0 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:32.603247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fe7a3-7eab-4a61-9c02-d98e97cb05bd None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:32.651662 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15da818-2359-452a-a5a8-3d9371599e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:32.653099 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15da818-2359-452a-a5a8-3d9371599e4e None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:32.653694 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15da818-2359-452a-a5a8-3d9371599e4e None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:32.654241 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15da818-2359-452a-a5a8-3d9371599e4e None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:32.655186 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15da818-2359-452a-a5a8-3d9371599e4e None admin] RBAC: Adding query filter params (name=reader) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:32.655757 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15da818-2359-452a-a5a8-3d9371599e4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:32.658816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15da818-2359-452a-a5a8-3d9371599e4e None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:32.669100 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583d4ac-b43a-41d3-a4f0-21d6704522c0 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:32.675521 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 65/126] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:32.675521 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15da818-2359-452a-a5a8-3d9371599e4e None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:32.714661 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d8af6-1132-46b7-a23d-a1950ea02a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:32.716450 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d8af6-1132-46b7-a23d-a1950ea02a37 None admin] REQUEST_METHOD: `PUT` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:32.716947 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d8af6-1132-46b7-a23d-a1950ea02a37 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:32.717502 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d8af6-1132-46b7-a23d-a1950ea02a37 None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855/users/e1895d390d79461cb033f7ffd725f75e/roles/722968fb4ca44c1795d61c44f61a78d9` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:32.720901 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d8af6-1132-46b7-a23d-a1950ea02a37 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f507bcdfd314874b0a378d7037ed855, user_id=e1895d390d79461cb033f7ffd725f75e, role_id=722968fb4ca44c1795d61c44f61a78d9)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:32.722710 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d8af6-1132-46b7-a23d-a1950ea02a37 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:32.785778 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15da818-2359-452a-a5a8-3d9371599e4e None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:32.820309 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911d691-7f94-46e1-b940-1246a118e242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:32.820715 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911d691-7f94-46e1-b940-1246a118e242 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:32.821991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911d691-7f94-46e1-b940-1246a118e242 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:32.821991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911d691-7f94-46e1-b940-1246a118e242 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:32.827967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 62/127] 10.222.0.18 () {58 vars in 1439 bytes} [Mon May 2 08:43:32 2022] PUT /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855/users/e1895d390d79461cb033f7ffd725f75e/roles/722968fb4ca44c1795d61c44f61a78d9 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:43:32.829134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d8af6-1132-46b7-a23d-a1950ea02a37 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:32.835610 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911d691-7f94-46e1-b940-1246a118e242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:32.841240 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-2911d691-7f94-46e1-b940-1246a118e242 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:32.841240 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:32.841240 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:32.841240 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:32.841240 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:32.841240 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:32.841240 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:32.841240 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:32.841240 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:32.841240 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:32.841240 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:32.841240 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:32.841240 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:32.841240 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:32.841240 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:32.841240 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:32.842490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:32.842490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:32.842490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:32.842490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:32.842490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:32.842490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:32.842490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:32.842490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:32.842490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:32.842490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:32.842490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:32.842490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:32.842490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:32.842490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:32.842490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:32.842490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:32.843282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:32.843282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:32.843282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:32.843282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:32.843282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:32.843282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:32.843282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:32.843282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:32.843282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:32.843282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:32.843282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:32.843282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:32.843282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 66/128] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:32.843977 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911d691-7f94-46e1-b940-1246a118e242 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:32.949947 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d8af6-1132-46b7-a23d-a1950ea02a37 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:32.985583 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911d691-7f94-46e1-b940-1246a118e242 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:32.987322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68a710-8ed6-481d-a6a7-2a160c7b2835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:32.988493 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68a710-8ed6-481d-a6a7-2a160c7b2835 None admin] REQUEST_METHOD: `PUT` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:32.989030 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68a710-8ed6-481d-a6a7-2a160c7b2835 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:32.989512 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68a710-8ed6-481d-a6a7-2a160c7b2835 None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855/users/01d461fea7474f0cabc39359a0a27117/roles/509216a314244b96b05d3fe56b0d9cd1` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:32.991909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68a710-8ed6-481d-a6a7-2a160c7b2835 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f507bcdfd314874b0a378d7037ed855, user_id=01d461fea7474f0cabc39359a0a27117, role_id=509216a314244b96b05d3fe56b0d9cd1)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:32.993793 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68a710-8ed6-481d-a6a7-2a160c7b2835 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:33.024960 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802df5f7-5861-4e3a-9784-5a7c368e3741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:33.025850 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802df5f7-5861-4e3a-9784-5a7c368e3741 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:33.026193 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802df5f7-5861-4e3a-9784-5a7c368e3741 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:33.026477 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802df5f7-5861-4e3a-9784-5a7c368e3741 None admin] PATH_INFO: `/v3/users/e66e85510acf459c8d0989d4d629f514` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:33.045238 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802df5f7-5861-4e3a-9784-5a7c368e3741 None admin] RBAC: Authorizing `identity:get_user(user_id=e66e85510acf459c8d0989d4d629f514)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:33.046795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802df5f7-5861-4e3a-9784-5a7c368e3741 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:33.049412 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 67/129] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:32 2022] GET /identity/v3/users/e66e85510acf459c8d0989d4d629f514 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:33.050243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802df5f7-5861-4e3a-9784-5a7c368e3741 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:33.068898 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 63/130] 10.222.0.18 () {58 vars in 1439 bytes} [Mon May 2 08:43:32 2022] PUT /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855/users/01d461fea7474f0cabc39359a0a27117/roles/509216a314244b96b05d3fe56b0d9cd1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:43:33.070167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68a710-8ed6-481d-a6a7-2a160c7b2835 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:33.175588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802df5f7-5861-4e3a-9784-5a7c368e3741 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:33.220796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5393e-8613-4a4b-96c4-3c2c04c29142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:33.224343 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5393e-8613-4a4b-96c4-3c2c04c29142 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:33.224343 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5393e-8613-4a4b-96c4-3c2c04c29142 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:33.224343 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5393e-8613-4a4b-96c4-3c2c04c29142 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:33.224343 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5393e-8613-4a4b-96c4-3c2c04c29142 None admin] RBAC: Adding query filter params (name=member) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:33.224343 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5393e-8613-4a4b-96c4-3c2c04c29142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:33.226013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5393e-8613-4a4b-96c4-3c2c04c29142 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:33.237611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68a710-8ed6-481d-a6a7-2a160c7b2835 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:33.244070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 68/131] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:33.249069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5393e-8613-4a4b-96c4-3c2c04c29142 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:33.282802 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdb63d-5da6-439d-8205-d786b805ebf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:33.284092 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdb63d-5da6-439d-8205-d786b805ebf3 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:33.284393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdb63d-5da6-439d-8205-d786b805ebf3 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:33.284680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdb63d-5da6-439d-8205-d786b805ebf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:33.365139 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5393e-8613-4a4b-96c4-3c2c04c29142 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:33.376717 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecdb63d-5da6-439d-8205-d786b805ebf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:33.378244 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecdb63d-5da6-439d-8205-d786b805ebf3 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:33.418863 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e73df-b2a7-4cd0-bf2e-e9dd5c47e376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:33.420207 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e73df-b2a7-4cd0-bf2e-e9dd5c47e376 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:33.420708 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e73df-b2a7-4cd0-bf2e-e9dd5c47e376 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:33.421196 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e73df-b2a7-4cd0-bf2e-e9dd5c47e376 None admin] PATH_INFO: `/v3/users/e1895d390d79461cb033f7ffd725f75e` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:33.423747 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e73df-b2a7-4cd0-bf2e-e9dd5c47e376 None admin] RBAC: Authorizing `identity:get_user(user_id=e1895d390d79461cb033f7ffd725f75e)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:33.432243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e73df-b2a7-4cd0-bf2e-e9dd5c47e376 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:33.433803 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 69/132] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:33 2022] GET /identity/v3/users/e1895d390d79461cb033f7ffd725f75e => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:33.441268 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e73df-b2a7-4cd0-bf2e-e9dd5c47e376 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:33.548516 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 64/133] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:43:33.554157 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdb63d-5da6-439d-8205-d786b805ebf3 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:33.586438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e73df-b2a7-4cd0-bf2e-e9dd5c47e376 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:33.624241 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0733210-9797-4712-a1d0-b40c67d84cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:33.625215 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0733210-9797-4712-a1d0-b40c67d84cb0 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:33.625687 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0733210-9797-4712-a1d0-b40c67d84cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:33.626036 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0733210-9797-4712-a1d0-b40c67d84cb0 None admin] PATH_INFO: `/v3/projects/dd6b9d6b7d7642479c074d032be2110b` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:33.635602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0733210-9797-4712-a1d0-b40c67d84cb0 None admin] RBAC: Authorizing `identity:get_project(project_id=dd6b9d6b7d7642479c074d032be2110b)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:33.635602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0733210-9797-4712-a1d0-b40c67d84cb0 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:33.637536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 70/134] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:33 2022] GET /identity/v3/projects/dd6b9d6b7d7642479c074d032be2110b => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:33.644164 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0733210-9797-4712-a1d0-b40c67d84cb0 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:33.717086 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdb63d-5da6-439d-8205-d786b805ebf3 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:33.751724 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064b909-7922-47d7-8d99-14d85bc89290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:33.752673 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064b909-7922-47d7-8d99-14d85bc89290 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:33.753009 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064b909-7922-47d7-8d99-14d85bc89290 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:33.753291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064b909-7922-47d7-8d99-14d85bc89290 None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:33.754545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064b909-7922-47d7-8d99-14d85bc89290 None admin] RBAC: Authorizing `identity:get_project(project_id=5f507bcdfd314874b0a378d7037ed855)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:33.756076 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064b909-7922-47d7-8d99-14d85bc89290 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:33.758146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 65/135] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:33 2022] GET /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:33.763812 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064b909-7922-47d7-8d99-14d85bc89290 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:33.850338 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0733210-9797-4712-a1d0-b40c67d84cb0 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:33.880256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064b909-7922-47d7-8d99-14d85bc89290 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:33.919813 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb71b3-bdc2-44c5-a1a5-b4bdb2e26462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:33.920652 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb71b3-bdc2-44c5-a1a5-b4bdb2e26462 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:33.921315 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb71b3-bdc2-44c5-a1a5-b4bdb2e26462 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:33.921735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb71b3-bdc2-44c5-a1a5-b4bdb2e26462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:33.922751 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb71b3-bdc2-44c5-a1a5-b4bdb2e26462 None admin] RBAC: Adding query filter params (role.id=b6b9080e8c6540ef9103f82c4cc9dc83, scope.project.id=5f507bcdfd314874b0a378d7037ed855, user.id=e66e85510acf459c8d0989d4d629f514) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:33.923165 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb71b3-bdc2-44c5-a1a5-b4bdb2e26462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:33.924951 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb71b3-bdc2-44c5-a1a5-b4bdb2e26462 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:33.930897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 66/136] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:43:33 2022] GET /identity/v3/role_assignments?user.id=e66e85510acf459c8d0989d4d629f514&scope.project.id=5f507bcdfd314874b0a378d7037ed855&role.id=b6b9080e8c6540ef9103f82c4cc9dc83 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:33.941607 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c615-e185-41c6-9387-e86d9c2e1c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:33.942536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c615-e185-41c6-9387-e86d9c2e1c0a None admin] REQUEST_METHOD: `PUT` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:33.942823 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c615-e185-41c6-9387-e86d9c2e1c0a None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:33.943105 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c615-e185-41c6-9387-e86d9c2e1c0a None admin] PATH_INFO: `/v3/projects/dd6b9d6b7d7642479c074d032be2110b/users/e1895d390d79461cb033f7ffd725f75e/roles/722968fb4ca44c1795d61c44f61a78d9` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:33.949094 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7c615-e185-41c6-9387-e86d9c2e1c0a None admin] RBAC: Authorizing `identity:create_grant(project_id=dd6b9d6b7d7642479c074d032be2110b, user_id=e1895d390d79461cb033f7ffd725f75e, role_id=722968fb4ca44c1795d61c44f61a78d9)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:33.951525 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7c615-e185-41c6-9387-e86d9c2e1c0a None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:34.060626 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 71/137] 10.222.0.18 () {58 vars in 1439 bytes} [Mon May 2 08:43:33 2022] PUT /identity/v3/projects/dd6b9d6b7d7642479c074d032be2110b/users/e1895d390d79461cb033f7ffd725f75e/roles/722968fb4ca44c1795d61c44f61a78d9 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 08:43:34.518932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1735c4-967c-4e2b-8d0d-3b4e5ca9cbc1 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:34.519323 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1735c4-967c-4e2b-8d0d-3b4e5ca9cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:34.519516 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1735c4-967c-4e2b-8d0d-3b4e5ca9cbc1 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:34.520938 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 67/138] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:34.526420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c66d1-8fdd-480d-a157-89b725309c92 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:34.526718 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c66d1-8fdd-480d-a157-89b725309c92 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:34.526998 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c66d1-8fdd-480d-a157-89b725309c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:34.553072 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-525c66d1-8fdd-480d-a157-89b725309c92 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:34.554331 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-525c66d1-8fdd-480d-a157-89b725309c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:34.640247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 72/139] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:34.685866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1735c4-967c-4e2b-8d0d-3b4e5ca9cbc1 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:34.808749 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1735c4-967c-4e2b-8d0d-3b4e5ca9cbc1 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:34.844591 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20faf2-693a-4743-82c6-00f15cec6202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:34.845398 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20faf2-693a-4743-82c6-00f15cec6202 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:34.845687 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20faf2-693a-4743-82c6-00f15cec6202 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:34.845969 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20faf2-693a-4743-82c6-00f15cec6202 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:34.847148 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20faf2-693a-4743-82c6-00f15cec6202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:34.848710 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20faf2-693a-4743-82c6-00f15cec6202 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:34.850438 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 68/140] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:43:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:34.855939 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c66d1-8fdd-480d-a157-89b725309c92 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:34.956668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c66d1-8fdd-480d-a157-89b725309c92 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:34.991067 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb70f61-f881-48bf-8525-69f65367ef3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:34.991743 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb70f61-f881-48bf-8525-69f65367ef3c None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:34.992029 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb70f61-f881-48bf-8525-69f65367ef3c None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:34.992341 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb70f61-f881-48bf-8525-69f65367ef3c None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:34.993065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb70f61-f881-48bf-8525-69f65367ef3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:34.994542 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb70f61-f881-48bf-8525-69f65367ef3c None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:35.127674 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 73/141] 10.222.0.18 () {60 vars in 1132 bytes} [Mon May 2 08:43:34 2022] POST /identity/v3/users => generated 283 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:43:36.141099 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b5483-5181-43e9-b13d-1f04ac408235 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:36.141575 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b5483-5181-43e9-b13d-1f04ac408235 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:36.141575 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b5483-5181-43e9-b13d-1f04ac408235 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:36.143264 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 69/142] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:36.158214 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b63f4-cb90-47d1-9e2f-61143f4539ed None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:36.159127 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b63f4-cb90-47d1-9e2f-61143f4539ed None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:36.159609 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b63f4-cb90-47d1-9e2f-61143f4539ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:36.180142 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-233b63f4-cb90-47d1-9e2f-61143f4539ed None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:36.181664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-233b63f4-cb90-47d1-9e2f-61143f4539ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:36.257592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 74/143] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:36.286928 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249df30-781e-41d7-b8c4-6d7d391c7c45 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:36.287557 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249df30-781e-41d7-b8c4-6d7d391c7c45 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:36.288039 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249df30-781e-41d7-b8c4-6d7d391c7c45 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:36.289645 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 70/144] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:36.295194 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bab57-bb5b-4c67-b1ff-14f6d11914c6 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:36.295747 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bab57-bb5b-4c67-b1ff-14f6d11914c6 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:36.296271 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bab57-bb5b-4c67-b1ff-14f6d11914c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:36.299744 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249df30-781e-41d7-b8c4-6d7d391c7c45 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:36.316072 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-974bab57-bb5b-4c67-b1ff-14f6d11914c6 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:36.317044 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-974bab57-bb5b-4c67-b1ff-14f6d11914c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:36.401768 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 75/145] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:36.421725 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249df30-781e-41d7-b8c4-6d7d391c7c45 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:36.434407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bab57-bb5b-4c67-b1ff-14f6d11914c6 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:36.465846 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c4c47-e2ae-4f05-9df2-a23f3646260e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:36.466681 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c4c47-e2ae-4f05-9df2-a23f3646260e None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:36.469937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c4c47-e2ae-4f05-9df2-a23f3646260e None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:36.470254 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c4c47-e2ae-4f05-9df2-a23f3646260e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:36.497052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c4c47-e2ae-4f05-9df2-a23f3646260e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:36.505583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-d26c4c47-e2ae-4f05-9df2-a23f3646260e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:43:36.505583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:36.505583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:36.505583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:36.505583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:36.505583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:36.505583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:36.505583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:36.505583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:36.505583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:36.505583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:36.505583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:36.505583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:36.505583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:36.505583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:36.505583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:36.506733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:36.506733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:36.506733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:36.506733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:36.506733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:36.506733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:36.506733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:36.506733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:36.506733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:36.506733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:36.506733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:36.506733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:43:36.506733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:36.506733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:36.506733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:36.506733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:36.507498 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:36.507498 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:36.507498 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:36.507498 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:36.507498 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:36.507498 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:36.507498 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:36.507498 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:36.507498 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:36.507498 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:36.507498 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:43:36.507498 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:43:36.511478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 71/146] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:43:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:36.517689 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c4c47-e2ae-4f05-9df2-a23f3646260e None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:36.573203 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bab57-bb5b-4c67-b1ff-14f6d11914c6 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:36.610807 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f51af9-a51d-4cad-9f72-ce05511c8fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:36.613063 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f51af9-a51d-4cad-9f72-ce05511c8fef None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:36.614194 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f51af9-a51d-4cad-9f72-ce05511c8fef None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:36.614446 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f51af9-a51d-4cad-9f72-ce05511c8fef None admin] PATH_INFO: `/v3/roles/member` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:36.643595 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f51af9-a51d-4cad-9f72-ce05511c8fef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:36.660384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-82f51af9-a51d-4cad-9f72-ce05511c8fef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:36.660384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:36.660384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:36.660384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:36.660384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:36.660384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:36.660384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:36.660384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:36.660384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:36.660384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:36.660384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:36.660384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:36.660384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:36.660384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:36.660384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:36.660384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:36.661259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:36.661259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:36.661259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:36.661259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:36.661259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:36.661259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:36.661259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:36.661259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:36.661259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:36.661259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:36.661259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:36.661259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:36.661259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:36.661259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:36.661259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:36.661259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:36.662112 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:36.662112 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:36.662112 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:36.662112 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:36.662112 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:36.662112 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:36.662112 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:36.662112 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:36.662112 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:36.662112 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:36.662112 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:36.662112 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:36.679013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 76/147] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:36.680138 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f51af9-a51d-4cad-9f72-ce05511c8fef None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:36.730721 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c4c47-e2ae-4f05-9df2-a23f3646260e None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:36.779261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fda77-b380-4632-a4b0-a8f532c4e472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:36.781625 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fda77-b380-4632-a4b0-a8f532c4e472 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:36.781941 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fda77-b380-4632-a4b0-a8f532c4e472 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:36.782220 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fda77-b380-4632-a4b0-a8f532c4e472 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:36.782992 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fda77-b380-4632-a4b0-a8f532c4e472 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:36.783309 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fda77-b380-4632-a4b0-a8f532c4e472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:36.784750 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fda77-b380-4632-a4b0-a8f532c4e472 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:36.804884 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 72/148] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:43:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:36.810595 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fda77-b380-4632-a4b0-a8f532c4e472 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:36.869332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f51af9-a51d-4cad-9f72-ce05511c8fef None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:36.918538 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc25262-6f32-4d18-b4a2-6df3231b76f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:36.919143 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc25262-6f32-4d18-b4a2-6df3231b76f9 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:36.919430 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc25262-6f32-4d18-b4a2-6df3231b76f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:36.919710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc25262-6f32-4d18-b4a2-6df3231b76f9 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:36.920505 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc25262-6f32-4d18-b4a2-6df3231b76f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:36.920827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc25262-6f32-4d18-b4a2-6df3231b76f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:36.925232 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc25262-6f32-4d18-b4a2-6df3231b76f9 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:36.945164 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 77/149] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:36.951525 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc25262-6f32-4d18-b4a2-6df3231b76f9 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:36.995154 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fda77-b380-4632-a4b0-a8f532c4e472 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:37.043716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa178096-f23d-417a-b6fb-40631035c02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:37.045096 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa178096-f23d-417a-b6fb-40631035c02c None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:37.045446 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa178096-f23d-417a-b6fb-40631035c02c None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:37.045732 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa178096-f23d-417a-b6fb-40631035c02c None admin] PATH_INFO: `/v3/users/e1895d390d79461cb033f7ffd725f75e` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:37.047328 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa178096-f23d-417a-b6fb-40631035c02c None admin] RBAC: Authorizing `identity:get_user(user_id=e1895d390d79461cb033f7ffd725f75e)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:37.050187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa178096-f23d-417a-b6fb-40631035c02c None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:37.051622 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 73/150] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:36 2022] GET /identity/v3/users/e1895d390d79461cb033f7ffd725f75e => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:37.055601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75cdd3-deb0-47bf-a063-606b990960d7 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:37.055601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75cdd3-deb0-47bf-a063-606b990960d7 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:37.055601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75cdd3-deb0-47bf-a063-606b990960d7 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:37.055601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 74/151] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:37.061579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510c0bb-a1a6-4210-bd4f-75b1c35cd461 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:37.061931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510c0bb-a1a6-4210-bd4f-75b1c35cd461 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:37.062144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510c0bb-a1a6-4210-bd4f-75b1c35cd461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:37.086982 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-c510c0bb-a1a6-4210-bd4f-75b1c35cd461 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:37.088938 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-c510c0bb-a1a6-4210-bd4f-75b1c35cd461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:37.099948 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc25262-6f32-4d18-b4a2-6df3231b76f9 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:37.134491 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abc513-4e58-4bb1-9fb2-b736f522a71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:37.135378 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abc513-4e58-4bb1-9fb2-b736f522a71f None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:37.135666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abc513-4e58-4bb1-9fb2-b736f522a71f None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:37.135947 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abc513-4e58-4bb1-9fb2-b736f522a71f None admin] PATH_INFO: `/v3/users/e1895d390d79461cb033f7ffd725f75e` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:37.137190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abc513-4e58-4bb1-9fb2-b736f522a71f None admin] RBAC: Authorizing `identity:get_user(user_id=e1895d390d79461cb033f7ffd725f75e)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:37.138661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abc513-4e58-4bb1-9fb2-b736f522a71f None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:37.141747 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 78/152] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:36 2022] GET /identity/v3/users/e1895d390d79461cb033f7ffd725f75e => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:37.142103 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abc513-4e58-4bb1-9fb2-b736f522a71f None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:37.163962 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 75/153] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:37.165576 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510c0bb-a1a6-4210-bd4f-75b1c35cd461 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:37.262605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abc513-4e58-4bb1-9fb2-b736f522a71f None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:37.295876 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510c0bb-a1a6-4210-bd4f-75b1c35cd461 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:37.311703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef9742-c3cf-490a-9fab-d451657b726c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:37.312443 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef9742-c3cf-490a-9fab-d451657b726c None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:37.315183 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef9742-c3cf-490a-9fab-d451657b726c None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:37.315183 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef9742-c3cf-490a-9fab-d451657b726c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:37.335244 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5123204-f60f-407f-89c6-fc3709a57e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:37.336321 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5123204-f60f-407f-89c6-fc3709a57e71 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:37.336804 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5123204-f60f-407f-89c6-fc3709a57e71 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:37.337297 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5123204-f60f-407f-89c6-fc3709a57e71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:37.389153 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef9742-c3cf-490a-9fab-d451657b726c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:37.391221 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef9742-c3cf-490a-9fab-d451657b726c None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:37.410088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5123204-f60f-407f-89c6-fc3709a57e71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:37.412774 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5123204-f60f-407f-89c6-fc3709a57e71 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:37.516931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 76/155] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:43:37.517093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 79/155] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:43:37.517706 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef9742-c3cf-490a-9fab-d451657b726c None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:37.518891 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36c70b-3234-44ab-8bdc-a29302c82fdb None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:37.519409 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36c70b-3234-44ab-8bdc-a29302c82fdb None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:37.519898 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36c70b-3234-44ab-8bdc-a29302c82fdb None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:37.525677 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 77/156] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:37.526665 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36c70b-3234-44ab-8bdc-a29302c82fdb None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:37.694801 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef9742-c3cf-490a-9fab-d451657b726c None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:37.697134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36c70b-3234-44ab-8bdc-a29302c82fdb None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:37.737185 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a765205-9a6a-40be-b469-71a4875e5c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:37.738427 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a765205-9a6a-40be-b469-71a4875e5c97 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:37.738936 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a765205-9a6a-40be-b469-71a4875e5c97 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:37.739412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a765205-9a6a-40be-b469-71a4875e5c97 None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:37.740085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f7eef-cc31-4658-a2ac-d680a286ece3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:37.740999 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f7eef-cc31-4658-a2ac-d680a286ece3 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:37.741280 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f7eef-cc31-4658-a2ac-d680a286ece3 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:37.741554 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f7eef-cc31-4658-a2ac-d680a286ece3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:37.741759 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a765205-9a6a-40be-b469-71a4875e5c97 None admin] RBAC: Authorizing `identity:get_project(project_id=5f507bcdfd314874b0a378d7037ed855)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:37.743527 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a765205-9a6a-40be-b469-71a4875e5c97 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:37.745488 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 78/157] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:37 2022] GET /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:37.746455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a765205-9a6a-40be-b469-71a4875e5c97 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:37.753123 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f7eef-cc31-4658-a2ac-d680a286ece3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:37.761117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-2b8f7eef-cc31-4658-a2ac-d680a286ece3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:43:37.761117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:37.761117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:37.761117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:37.761117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:37.761117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:37.761117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:37.761117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:37.761117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:37.761117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:37.761117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:37.761117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:37.761117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:37.761117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:37.761117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:37.761117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:37.762039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:37.762039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:37.762039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:37.762039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:37.762039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:37.762039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:37.762039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:37.762039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:37.762039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:37.762039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:37.762039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:37.762039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:37.762039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:37.762039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:37.762039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:37.762039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:37.762830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:37.762830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:37.762830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:37.762830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:37.762830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:37.762830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:37.762830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:37.762830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:37.762830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:37.762830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:37.762830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:43:37.762830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:37.762830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 80/158] 10.222.0.18 () {56 vars in 1096 bytes} [Mon May 2 08:43:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:37.763993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcd1b8-39da-4fe3-be9e-4b040031a09b None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:37.763993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcd1b8-39da-4fe3-be9e-4b040031a09b None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:37.763993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcd1b8-39da-4fe3-be9e-4b040031a09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:37.782836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-7bbcd1b8-39da-4fe3-be9e-4b040031a09b None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:37.784113 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-7bbcd1b8-39da-4fe3-be9e-4b040031a09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:37.851943 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 81/159] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:37.852826 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcd1b8-39da-4fe3-be9e-4b040031a09b None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:37.874170 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a765205-9a6a-40be-b469-71a4875e5c97 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:37.913277 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0039e06-2359-47b3-82f7-7844e656548d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:37.914707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0039e06-2359-47b3-82f7-7844e656548d None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:37.915231 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0039e06-2359-47b3-82f7-7844e656548d None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:37.915713 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0039e06-2359-47b3-82f7-7844e656548d None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:37.917209 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0039e06-2359-47b3-82f7-7844e656548d None admin] RBAC: Authorizing `identity:get_project(project_id=5f507bcdfd314874b0a378d7037ed855)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:37.918914 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0039e06-2359-47b3-82f7-7844e656548d None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:37.921110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 79/160] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:37 2022] GET /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:37.922625 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0039e06-2359-47b3-82f7-7844e656548d None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:37.953777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcd1b8-39da-4fe3-be9e-4b040031a09b None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:37.988399 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0231d2-9bc5-4ba7-8a25-da3fe2a677cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:37.989068 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0231d2-9bc5-4ba7-8a25-da3fe2a677cf None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:37.989353 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0231d2-9bc5-4ba7-8a25-da3fe2a677cf None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:37.989631 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0231d2-9bc5-4ba7-8a25-da3fe2a677cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:37.990504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0231d2-9bc5-4ba7-8a25-da3fe2a677cf None admin] RBAC: Adding query filter params (role.id=722968fb4ca44c1795d61c44f61a78d9, scope.project.id=5f507bcdfd314874b0a378d7037ed855, user.id=e1895d390d79461cb033f7ffd725f75e) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:37.990824 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0231d2-9bc5-4ba7-8a25-da3fe2a677cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:37.992318 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0231d2-9bc5-4ba7-8a25-da3fe2a677cf None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:37.998807 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 82/161] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:43:37 2022] GET /identity/v3/role_assignments?user.id=e1895d390d79461cb033f7ffd725f75e&scope.project.id=5f507bcdfd314874b0a378d7037ed855&role.id=722968fb4ca44c1795d61c44f61a78d9 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:37.999841 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0231d2-9bc5-4ba7-8a25-da3fe2a677cf None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:38.046429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0039e06-2359-47b3-82f7-7844e656548d None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:38.088403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7b53c-82af-496d-9a14-463e9b49c058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:38.089703 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7b53c-82af-496d-9a14-463e9b49c058 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:38.090191 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7b53c-82af-496d-9a14-463e9b49c058 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:38.090715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7b53c-82af-496d-9a14-463e9b49c058 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:38.091667 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7b53c-82af-496d-9a14-463e9b49c058 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:38.092285 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7b53c-82af-496d-9a14-463e9b49c058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:38.094172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7b53c-82af-496d-9a14-463e9b49c058 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:38.105423 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 80/162] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:38.106695 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7b53c-82af-496d-9a14-463e9b49c058 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:38.141261 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0231d2-9bc5-4ba7-8a25-da3fe2a677cf None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:38.217520 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b3371-e752-4a56-bcd6-64d3af0733fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:38.218790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b3371-e752-4a56-bcd6-64d3af0733fd None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:38.219467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b3371-e752-4a56-bcd6-64d3af0733fd None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:38.221764 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b3371-e752-4a56-bcd6-64d3af0733fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:38.246213 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b3371-e752-4a56-bcd6-64d3af0733fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:38.263316 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-9c1b3371-e752-4a56-bcd6-64d3af0733fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:38.263316 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:38.263316 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:38.263316 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:38.263316 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:38.263316 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:38.263316 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:38.263316 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:38.263316 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:38.263316 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:38.263316 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:38.263316 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:38.263316 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:38.263316 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:38.263316 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:38.263316 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:38.264709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:38.264709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:38.264709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:38.264709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:38.264709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:38.264709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:38.264709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:38.264709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:38.264709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:38.264709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:38.264709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:38.264709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:38.264709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:38.264709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:38.264709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:38.264709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:38.265557 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:38.265557 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:38.265557 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:38.265557 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:38.265557 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:38.265557 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:38.265557 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:38.265557 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:38.265557 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:38.265557 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:38.265557 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:38.265557 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:38.271792 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 83/163] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:38.274800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b3371-e752-4a56-bcd6-64d3af0733fd None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:38.311775 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7b53c-82af-496d-9a14-463e9b49c058 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:38.348486 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cba34-659e-459b-ad13-84d9b8f0a04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:38.349501 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cba34-659e-459b-ad13-84d9b8f0a04b None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:38.350003 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cba34-659e-459b-ad13-84d9b8f0a04b None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:38.350486 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cba34-659e-459b-ad13-84d9b8f0a04b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:38.351521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42cba34-659e-459b-ad13-84d9b8f0a04b None admin] RBAC: Adding query filter params (role.id=b860fb30a96b4b2ea790453a2a4f6044, scope.project.id=5f507bcdfd314874b0a378d7037ed855, user.id=e1895d390d79461cb033f7ffd725f75e) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:38.352077 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42cba34-659e-459b-ad13-84d9b8f0a04b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:38.353742 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42cba34-659e-459b-ad13-84d9b8f0a04b None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:38.368085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 81/164] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:43:38 2022] GET /identity/v3/role_assignments?user.id=e1895d390d79461cb033f7ffd725f75e&scope.project.id=5f507bcdfd314874b0a378d7037ed855&role.id=b860fb30a96b4b2ea790453a2a4f6044 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:38.370218 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08cd7b-841a-4c42-9ff1-d421770ea738 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:38.370717 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08cd7b-841a-4c42-9ff1-d421770ea738 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:38.371267 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08cd7b-841a-4c42-9ff1-d421770ea738 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:38.373105 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 82/165] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:38.374008 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08cd7b-841a-4c42-9ff1-d421770ea738 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:38.402042 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b3371-e752-4a56-bcd6-64d3af0733fd None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:38.444077 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d9573-12b8-4e40-b694-4cd98e838645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:38.444077 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d9573-12b8-4e40-b694-4cd98e838645 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:38.444077 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d9573-12b8-4e40-b694-4cd98e838645 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:38.444077 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d9573-12b8-4e40-b694-4cd98e838645 None admin] PATH_INFO: `/v3/users/01d461fea7474f0cabc39359a0a27117` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:38.444922 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d9573-12b8-4e40-b694-4cd98e838645 None admin] RBAC: Authorizing `identity:get_user(user_id=01d461fea7474f0cabc39359a0a27117)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:38.444922 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d9573-12b8-4e40-b694-4cd98e838645 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:38.444922 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 84/166] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:38 2022] GET /identity/v3/users/01d461fea7474f0cabc39359a0a27117 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:38.445819 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea03356-d965-464e-90e3-02b78990a511 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:38.446112 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea03356-d965-464e-90e3-02b78990a511 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:38.446386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea03356-d965-464e-90e3-02b78990a511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:38.463646 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-3ea03356-d965-464e-90e3-02b78990a511 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:38.467480 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-3ea03356-d965-464e-90e3-02b78990a511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:38.528551 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08cd7b-841a-4c42-9ff1-d421770ea738 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:38.542833 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 85/167] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:38.543773 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea03356-d965-464e-90e3-02b78990a511 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:38.576281 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5cee8-71ce-4590-889b-a4a0277c87a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:38.577338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5cee8-71ce-4590-889b-a4a0277c87a5 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:38.577829 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5cee8-71ce-4590-889b-a4a0277c87a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:38.578664 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5cee8-71ce-4590-889b-a4a0277c87a5 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:38.579917 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5cee8-71ce-4590-889b-a4a0277c87a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:38.580465 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5cee8-71ce-4590-889b-a4a0277c87a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:38.582219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5cee8-71ce-4590-889b-a4a0277c87a5 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:38.595832 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 83/168] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:38.601621 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5cee8-71ce-4590-889b-a4a0277c87a5 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:38.679533 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea03356-d965-464e-90e3-02b78990a511 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:38.716638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c7197-b3aa-4712-bcc7-1fe245067b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:38.717300 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c7197-b3aa-4712-bcc7-1fe245067b68 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:38.717579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c7197-b3aa-4712-bcc7-1fe245067b68 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:38.717852 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c7197-b3aa-4712-bcc7-1fe245067b68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:38.735692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5cee8-71ce-4590-889b-a4a0277c87a5 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:38.772696 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea973004-3d4c-40a3-b5e1-6ef79881a8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:38.773975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea973004-3d4c-40a3-b5e1-6ef79881a8e6 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:38.774534 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea973004-3d4c-40a3-b5e1-6ef79881a8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:38.775016 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea973004-3d4c-40a3-b5e1-6ef79881a8e6 None admin] PATH_INFO: `/v3/users/e1895d390d79461cb033f7ffd725f75e` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:38.776841 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea973004-3d4c-40a3-b5e1-6ef79881a8e6 None admin] RBAC: Authorizing `identity:get_user(user_id=e1895d390d79461cb033f7ffd725f75e)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:38.778642 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea973004-3d4c-40a3-b5e1-6ef79881a8e6 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:38.781341 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 84/169] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:38 2022] GET /identity/v3/users/e1895d390d79461cb033f7ffd725f75e => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:38.782836 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea973004-3d4c-40a3-b5e1-6ef79881a8e6 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:38.790047 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c7197-b3aa-4712-bcc7-1fe245067b68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:38.791543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c7197-b3aa-4712-bcc7-1fe245067b68 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:38.896320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 86/170] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:43:38.897111 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c7197-b3aa-4712-bcc7-1fe245067b68 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:38.902915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea973004-3d4c-40a3-b5e1-6ef79881a8e6 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:38.941290 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fff368-1c11-4daf-9ab8-4e4cbdc93d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:38.942631 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fff368-1c11-4daf-9ab8-4e4cbdc93d32 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:38.943131 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fff368-1c11-4daf-9ab8-4e4cbdc93d32 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:38.943623 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fff368-1c11-4daf-9ab8-4e4cbdc93d32 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:38.955439 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fff368-1c11-4daf-9ab8-4e4cbdc93d32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:38.963803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-f2fff368-1c11-4daf-9ab8-4e4cbdc93d32 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 02 08:43:38.963803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:38.963803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:38.963803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:38.963803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:38.963803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:38.963803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:38.963803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:38.963803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:38.963803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:38.963803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:38.963803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:38.963803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:38.963803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:38.963803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:38.963803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:38.964755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:38.964755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:38.964755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:38.964755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:38.964755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:38.964755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:38.964755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:38.964755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:38.964755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:38.964755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:38.964755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:38.964755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:43:38.964755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:38.964755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:38.964755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:38.964755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:38.965538 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:38.965538 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:38.965538 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:38.965538 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:38.965538 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:38.965538 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:38.965538 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:38.965538 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:38.965538 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:38.965538 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:38.965538 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 02 08:43:38.965538 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:43:38.968160 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 85/171] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:38.969689 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fff368-1c11-4daf-9ab8-4e4cbdc93d32 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:39.002697 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c7197-b3aa-4712-bcc7-1fe245067b68 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:39.037187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90c626-2ac0-4f0e-ad69-ed3dbfdfba2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:39.037843 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90c626-2ac0-4f0e-ad69-ed3dbfdfba2f None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:39.038123 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90c626-2ac0-4f0e-ad69-ed3dbfdfba2f None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:39.038418 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90c626-2ac0-4f0e-ad69-ed3dbfdfba2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:39.081773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fff368-1c11-4daf-9ab8-4e4cbdc93d32 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:39.122985 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051996fe-634e-4ef3-a229-b06086638259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:39.123979 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051996fe-634e-4ef3-a229-b06086638259 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:39.124185 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051996fe-634e-4ef3-a229-b06086638259 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:39.124437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051996fe-634e-4ef3-a229-b06086638259 None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:39.125861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051996fe-634e-4ef3-a229-b06086638259 None admin] RBAC: Authorizing `identity:get_project(project_id=5f507bcdfd314874b0a378d7037ed855)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:39.127355 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051996fe-634e-4ef3-a229-b06086638259 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:39.129151 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 86/172] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:38 2022] GET /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:39.130354 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051996fe-634e-4ef3-a229-b06086638259 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:39.132927 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90c626-2ac0-4f0e-ad69-ed3dbfdfba2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:39.135575 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90c626-2ac0-4f0e-ad69-ed3dbfdfba2f None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:39.247879 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051996fe-634e-4ef3-a229-b06086638259 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:39.264269 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 87/173] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:43:39.266775 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90c626-2ac0-4f0e-ad69-ed3dbfdfba2f None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:39.320246 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b20f0c-9190-4d0a-b034-3ebd6ed63ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:39.320934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b20f0c-9190-4d0a-b034-3ebd6ed63ac9 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:39.321172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b20f0c-9190-4d0a-b034-3ebd6ed63ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:39.321445 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b20f0c-9190-4d0a-b034-3ebd6ed63ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:39.322199 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b20f0c-9190-4d0a-b034-3ebd6ed63ac9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:39.322508 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b20f0c-9190-4d0a-b034-3ebd6ed63ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:39.324204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b20f0c-9190-4d0a-b034-3ebd6ed63ac9 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:39.343193 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 87/174] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:39.344727 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b20f0c-9190-4d0a-b034-3ebd6ed63ac9 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:39.390938 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90c626-2ac0-4f0e-ad69-ed3dbfdfba2f None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:39.438795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356852e-3b64-40b8-b353-761898d1b040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:39.439664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356852e-3b64-40b8-b353-761898d1b040 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:39.439946 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356852e-3b64-40b8-b353-761898d1b040 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:39.440248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356852e-3b64-40b8-b353-761898d1b040 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:39.441101 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356852e-3b64-40b8-b353-761898d1b040 None admin] RBAC: Adding query filter params (role.id=509216a314244b96b05d3fe56b0d9cd1, scope.project.id=5f507bcdfd314874b0a378d7037ed855, user.id=01d461fea7474f0cabc39359a0a27117) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:39.441412 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356852e-3b64-40b8-b353-761898d1b040 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:39.442928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356852e-3b64-40b8-b353-761898d1b040 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:39.450163 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 88/175] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:43:39 2022] GET /identity/v3/role_assignments?user.id=01d461fea7474f0cabc39359a0a27117&scope.project.id=5f507bcdfd314874b0a378d7037ed855&role.id=509216a314244b96b05d3fe56b0d9cd1 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:39.451260 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356852e-3b64-40b8-b353-761898d1b040 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:39.661200 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b20f0c-9190-4d0a-b034-3ebd6ed63ac9 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:39.712954 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356852e-3b64-40b8-b353-761898d1b040 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:39.728138 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9711f0-26e1-4004-90b7-7a10880a4d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:39.729009 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9711f0-26e1-4004-90b7-7a10880a4d6a None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:39.729290 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9711f0-26e1-4004-90b7-7a10880a4d6a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:39.729561 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9711f0-26e1-4004-90b7-7a10880a4d6a None admin] PATH_INFO: `/v3/projects/dd6b9d6b7d7642479c074d032be2110b` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:39.731162 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9711f0-26e1-4004-90b7-7a10880a4d6a None admin] RBAC: Authorizing `identity:get_project(project_id=dd6b9d6b7d7642479c074d032be2110b)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:39.732662 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9711f0-26e1-4004-90b7-7a10880a4d6a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:39.739985 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 88/176] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:39 2022] GET /identity/v3/projects/dd6b9d6b7d7642479c074d032be2110b => generated 312 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:39.741386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26e88e-726f-4a63-b1a3-41ba5b6cd30d None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:39.741675 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26e88e-726f-4a63-b1a3-41ba5b6cd30d None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:39.741947 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26e88e-726f-4a63-b1a3-41ba5b6cd30d None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:39.743552 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 89/177] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:39.744629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26e88e-726f-4a63-b1a3-41ba5b6cd30d None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:39.755495 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e61e4a-cb01-4939-a0ff-2e2da0d03843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:39.756428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e61e4a-cb01-4939-a0ff-2e2da0d03843 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:39.756713 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e61e4a-cb01-4939-a0ff-2e2da0d03843 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:39.756989 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e61e4a-cb01-4939-a0ff-2e2da0d03843 None admin] PATH_INFO: `/v3/users/e66e85510acf459c8d0989d4d629f514` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:39.758377 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e61e4a-cb01-4939-a0ff-2e2da0d03843 None admin] RBAC: Authorizing `identity:get_user(user_id=e66e85510acf459c8d0989d4d629f514)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:39.759837 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e61e4a-cb01-4939-a0ff-2e2da0d03843 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:39.761517 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 89/178] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:39 2022] GET /identity/v3/users/e66e85510acf459c8d0989d4d629f514 => generated 289 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:39.762669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb465fc-a343-4547-a8cd-02addff3e429 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:39.762957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb465fc-a343-4547-a8cd-02addff3e429 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:39.763233 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb465fc-a343-4547-a8cd-02addff3e429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:39.790747 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-0bb465fc-a343-4547-a8cd-02addff3e429 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:39.792346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-0bb465fc-a343-4547-a8cd-02addff3e429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:39.866331 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26e88e-726f-4a63-b1a3-41ba5b6cd30d None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:39.878349 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 90/179] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:39.879590 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb465fc-a343-4547-a8cd-02addff3e429 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:39.922298 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46493c57-9438-414c-8265-81b3c56b72ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:39.923015 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46493c57-9438-414c-8265-81b3c56b72ee None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:39.923295 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46493c57-9438-414c-8265-81b3c56b72ee None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:39.923566 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46493c57-9438-414c-8265-81b3c56b72ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:39.924481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46493c57-9438-414c-8265-81b3c56b72ee None admin] RBAC: Adding query filter params (role.id=722968fb4ca44c1795d61c44f61a78d9, scope.project.id=dd6b9d6b7d7642479c074d032be2110b, user.id=e1895d390d79461cb033f7ffd725f75e) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:39.924790 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46493c57-9438-414c-8265-81b3c56b72ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:39.926313 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46493c57-9438-414c-8265-81b3c56b72ee None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:39.933170 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 90/180] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:43:39 2022] GET /identity/v3/role_assignments?user.id=e1895d390d79461cb033f7ffd725f75e&scope.project.id=dd6b9d6b7d7642479c074d032be2110b&role.id=722968fb4ca44c1795d61c44f61a78d9 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:39.933865 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46493c57-9438-414c-8265-81b3c56b72ee None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:40.020568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb465fc-a343-4547-a8cd-02addff3e429 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:40.049277 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46493c57-9438-414c-8265-81b3c56b72ee None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:40.074188 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09281acc-7990-48af-856f-8700d4389a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:40.075124 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09281acc-7990-48af-856f-8700d4389a4c None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:40.075449 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09281acc-7990-48af-856f-8700d4389a4c None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:40.075728 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09281acc-7990-48af-856f-8700d4389a4c None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:40.076993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09281acc-7990-48af-856f-8700d4389a4c None admin] RBAC: Authorizing `identity:get_project(project_id=5f507bcdfd314874b0a378d7037ed855)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:40.078705 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09281acc-7990-48af-856f-8700d4389a4c None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:40.080751 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 91/181] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:39 2022] GET /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:40.089163 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09281acc-7990-48af-856f-8700d4389a4c None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:40.091344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df69e5b-9387-4b8e-8b99-e1cf6e36df2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:40.092443 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df69e5b-9387-4b8e-8b99-e1cf6e36df2d None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:40.092973 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df69e5b-9387-4b8e-8b99-e1cf6e36df2d None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:40.093464 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df69e5b-9387-4b8e-8b99-e1cf6e36df2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:40.107779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df69e5b-9387-4b8e-8b99-e1cf6e36df2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:40.118596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-1df69e5b-9387-4b8e-8b99-e1cf6e36df2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:43:40.118596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:40.118596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:40.118596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:40.118596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:40.118596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:40.118596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:40.118596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:40.118596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:40.118596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:40.118596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:40.118596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:40.118596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:40.118596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:40.118596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:40.118596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:40.119582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:40.119582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:40.119582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:40.119582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:40.119582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:40.119582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:40.119582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:40.119582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:40.119582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:40.119582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:40.119582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:40.119582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:43:40.119582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:40.119582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:40.119582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:40.119582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:40.120414 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:40.120414 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:40.120414 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:40.120414 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:40.120414 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:40.120414 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:40.120414 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:40.120414 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:40.120414 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:40.120414 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:40.120414 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:43:40.120414 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:43:40.123646 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 91/182] 10.222.0.18 () {56 vars in 1096 bytes} [Mon May 2 08:43:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:40.131120 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df69e5b-9387-4b8e-8b99-e1cf6e36df2d None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:40.221889 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09281acc-7990-48af-856f-8700d4389a4c None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:40.266192 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c6792-b4c3-4ed7-88cb-6baf82fcb586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:40.267124 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c6792-b4c3-4ed7-88cb-6baf82fcb586 None admin] REQUEST_METHOD: `PUT` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:40.267560 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c6792-b4c3-4ed7-88cb-6baf82fcb586 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:40.267838 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c6792-b4c3-4ed7-88cb-6baf82fcb586 None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855/users/e66e85510acf459c8d0989d4d629f514/roles/b6b9080e8c6540ef9103f82c4cc9dc83` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:40.276277 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df69e5b-9387-4b8e-8b99-e1cf6e36df2d None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:40.276914 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c6792-b4c3-4ed7-88cb-6baf82fcb586 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f507bcdfd314874b0a378d7037ed855, user_id=e66e85510acf459c8d0989d4d629f514, role_id=b6b9080e8c6540ef9103f82c4cc9dc83)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:40.278392 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c6792-b4c3-4ed7-88cb-6baf82fcb586 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:40.315335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eca0a9-f4cc-48ea-a9f9-a393d730ef44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:40.316012 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eca0a9-f4cc-48ea-a9f9-a393d730ef44 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:40.316393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eca0a9-f4cc-48ea-a9f9-a393d730ef44 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:40.316775 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eca0a9-f4cc-48ea-a9f9-a393d730ef44 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:40.317572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eca0a9-f4cc-48ea-a9f9-a393d730ef44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:40.317890 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eca0a9-f4cc-48ea-a9f9-a393d730ef44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:40.319296 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eca0a9-f4cc-48ea-a9f9-a393d730ef44 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:40.328976 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 92/183] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:40.334435 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eca0a9-f4cc-48ea-a9f9-a393d730ef44 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:40.373659 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 92/184] 10.222.0.18 () {58 vars in 1439 bytes} [Mon May 2 08:43:40 2022] PUT /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855/users/e66e85510acf459c8d0989d4d629f514/roles/b6b9080e8c6540ef9103f82c4cc9dc83 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:43:40.397685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e9866-6fd4-4416-9032-04248e90e6e2 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:40.398014 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e9866-6fd4-4416-9032-04248e90e6e2 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:40.398249 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e9866-6fd4-4416-9032-04248e90e6e2 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:40.399608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 93/185] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:40.406780 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31cd29-2dd0-4aa2-a050-c1fa4b34ac10 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:40.407569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31cd29-2dd0-4aa2-a050-c1fa4b34ac10 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:40.408090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31cd29-2dd0-4aa2-a050-c1fa4b34ac10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:40.428158 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-2b31cd29-2dd0-4aa2-a050-c1fa4b34ac10 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:40.429626 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-2b31cd29-2dd0-4aa2-a050-c1fa4b34ac10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:40.466892 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eca0a9-f4cc-48ea-a9f9-a393d730ef44 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:40.508252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 94/186] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:43:40.513025 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c0a4d-9f88-479d-8248-cbff113afce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:40.514273 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c0a4d-9f88-479d-8248-cbff113afce4 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:40.514777 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c0a4d-9f88-479d-8248-cbff113afce4 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:40.515271 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c0a4d-9f88-479d-8248-cbff113afce4 None admin] PATH_INFO: `/v3/users/c444ef0325ff4dd1a6c38dad34cf7296` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:40.528349 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31cd29-2dd0-4aa2-a050-c1fa4b34ac10 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:40.534852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c0a4d-9f88-479d-8248-cbff113afce4 None admin] RBAC: Authorizing `identity:get_user(user_id=c444ef0325ff4dd1a6c38dad34cf7296)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:40.537636 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c0a4d-9f88-479d-8248-cbff113afce4 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:40.540541 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 93/187] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:40 2022] GET /identity/v3/users/c444ef0325ff4dd1a6c38dad34cf7296 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:40.548195 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c0a4d-9f88-479d-8248-cbff113afce4 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:40.646658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31cd29-2dd0-4aa2-a050-c1fa4b34ac10 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:40.680283 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c0a4d-9f88-479d-8248-cbff113afce4 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:40.686828 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f366dcd-9f09-402e-bffe-2f6cec078129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:40.688375 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f366dcd-9f09-402e-bffe-2f6cec078129 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:40.688676 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f366dcd-9f09-402e-bffe-2f6cec078129 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:40.688950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f366dcd-9f09-402e-bffe-2f6cec078129 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:40.700206 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f366dcd-9f09-402e-bffe-2f6cec078129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:40.709170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-6f366dcd-9f09-402e-bffe-2f6cec078129 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:43:40.709170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:40.709170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:40.709170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:40.709170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:40.709170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:40.709170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:40.709170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:40.709170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:40.709170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:40.709170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:40.709170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:40.709170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:40.709170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:40.709170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:40.709170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:40.710055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:40.710055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:40.710055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:40.710055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:40.710055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:40.710055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:40.710055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:40.710055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:40.710055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:40.710055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:40.710055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:40.710055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:40.710055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:40.710055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:40.710055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:40.710055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:40.710831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:40.710831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:40.710831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:40.710831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:40.710831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:40.710831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:40.710831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:40.710831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:40.710831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:40.710831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:40.710831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:43:40.710831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:40.710831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 95/188] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:43:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:43:40.717197 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f366dcd-9f09-402e-bffe-2f6cec078129 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:40.722497 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ff5b2-d694-4336-95e5-6d17312fa5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:40.723149 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ff5b2-d694-4336-95e5-6d17312fa5ae None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:40.723429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ff5b2-d694-4336-95e5-6d17312fa5ae None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:40.723748 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ff5b2-d694-4336-95e5-6d17312fa5ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:40.789907 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ff5b2-d694-4336-95e5-6d17312fa5ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:40.791453 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ff5b2-d694-4336-95e5-6d17312fa5ae None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:40.828756 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f366dcd-9f09-402e-bffe-2f6cec078129 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:40.861184 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cae57-65be-485a-a1bb-f30b248f4bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:40.861842 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cae57-65be-485a-a1bb-f30b248f4bbe None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:40.862121 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cae57-65be-485a-a1bb-f30b248f4bbe None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:40.862391 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cae57-65be-485a-a1bb-f30b248f4bbe None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:40.863244 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cae57-65be-485a-a1bb-f30b248f4bbe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:40.863430 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cae57-65be-485a-a1bb-f30b248f4bbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:40.864829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cae57-65be-485a-a1bb-f30b248f4bbe None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:40.872724 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 96/189] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:43:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:40.877920 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb3998-5522-4678-9c2c-dea42bf9509d None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:40.877920 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb3998-5522-4678-9c2c-dea42bf9509d None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:40.877920 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb3998-5522-4678-9c2c-dea42bf9509d None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:40.877920 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 97/190] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:40.879749 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb3998-5522-4678-9c2c-dea42bf9509d None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:40.898832 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 94/191] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 02 08:43:40.898832 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f4dbe-e518-40e5-98dc-6d18aa5d359e None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:40.898832 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f4dbe-e518-40e5-98dc-6d18aa5d359e None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:40.898832 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f4dbe-e518-40e5-98dc-6d18aa5d359e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:40.912154 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-b52f4dbe-e518-40e5-98dc-6d18aa5d359e None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:40.913398 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-b52f4dbe-e518-40e5-98dc-6d18aa5d359e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:40.979747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 95/192] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:40.984829 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f4dbe-e518-40e5-98dc-6d18aa5d359e None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:40.992721 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb3998-5522-4678-9c2c-dea42bf9509d None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:41.033147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470900e9-e2b7-4ca1-84d6-0737ce0d3e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:41.034007 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470900e9-e2b7-4ca1-84d6-0737ce0d3e5d None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:41.034285 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470900e9-e2b7-4ca1-84d6-0737ce0d3e5d None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:41.034557 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470900e9-e2b7-4ca1-84d6-0737ce0d3e5d None admin] PATH_INFO: `/v3/users/c444ef0325ff4dd1a6c38dad34cf7296` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:41.035734 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470900e9-e2b7-4ca1-84d6-0737ce0d3e5d None admin] RBAC: Authorizing `identity:get_user(user_id=c444ef0325ff4dd1a6c38dad34cf7296)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:41.037233 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470900e9-e2b7-4ca1-84d6-0737ce0d3e5d None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:41.039009 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 98/193] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:40 2022] GET /identity/v3/users/c444ef0325ff4dd1a6c38dad34cf7296 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:41.044078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470900e9-e2b7-4ca1-84d6-0737ce0d3e5d None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:41.081325 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f4dbe-e518-40e5-98dc-6d18aa5d359e None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:41.114144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32096e4b-ee89-496b-8048-937ecded7d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:41.115056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32096e4b-ee89-496b-8048-937ecded7d27 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:41.115337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32096e4b-ee89-496b-8048-937ecded7d27 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:41.115659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32096e4b-ee89-496b-8048-937ecded7d27 None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:41.116865 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32096e4b-ee89-496b-8048-937ecded7d27 None admin] RBAC: Authorizing `identity:get_project(project_id=8308537c26a949d68d16cd15829ed9e1)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:41.118332 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32096e4b-ee89-496b-8048-937ecded7d27 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:41.125242 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 96/194] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:40 2022] GET /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:41.125242 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32096e4b-ee89-496b-8048-937ecded7d27 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:41.148159 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470900e9-e2b7-4ca1-84d6-0737ce0d3e5d None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:41.182940 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3fd3e-efc7-4f26-9695-83c451b2f300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:41.184251 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3fd3e-efc7-4f26-9695-83c451b2f300 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:41.184541 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3fd3e-efc7-4f26-9695-83c451b2f300 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:41.185078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3fd3e-efc7-4f26-9695-83c451b2f300 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:41.186446 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3fd3e-efc7-4f26-9695-83c451b2f300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:41.188874 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3fd3e-efc7-4f26-9695-83c451b2f300 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:41.192389 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 99/195] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:43:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:41.193436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3fd3e-efc7-4f26-9695-83c451b2f300 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:41.222397 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32096e4b-ee89-496b-8048-937ecded7d27 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:41.255299 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545cd07-d5ef-4a54-a9bd-602674406448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:41.255925 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545cd07-d5ef-4a54-a9bd-602674406448 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:41.256248 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545cd07-d5ef-4a54-a9bd-602674406448 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:41.256519 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545cd07-d5ef-4a54-a9bd-602674406448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:41.293020 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3fd3e-efc7-4f26-9695-83c451b2f300 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:41.322473 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545cd07-d5ef-4a54-a9bd-602674406448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:41.324169 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545cd07-d5ef-4a54-a9bd-602674406448 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:41.336411 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955655f0-3c70-4485-b992-dbbb232d415c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:41.337450 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955655f0-3c70-4485-b992-dbbb232d415c None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:41.338288 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955655f0-3c70-4485-b992-dbbb232d415c None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:41.338743 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955655f0-3c70-4485-b992-dbbb232d415c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:41.339957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955655f0-3c70-4485-b992-dbbb232d415c None admin] RBAC: Adding query filter params (role.id=509216a314244b96b05d3fe56b0d9cd1, scope.project.id=8308537c26a949d68d16cd15829ed9e1, user.id=c444ef0325ff4dd1a6c38dad34cf7296) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:41.340594 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955655f0-3c70-4485-b992-dbbb232d415c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:41.342469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955655f0-3c70-4485-b992-dbbb232d415c None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:41.360076 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 100/196] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:43:41 2022] GET /identity/v3/role_assignments?user.id=c444ef0325ff4dd1a6c38dad34cf7296&scope.project.id=8308537c26a949d68d16cd15829ed9e1&role.id=509216a314244b96b05d3fe56b0d9cd1 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:41.360076 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955655f0-3c70-4485-b992-dbbb232d415c None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:41.459405 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 97/197] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:43:41.465991 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545cd07-d5ef-4a54-a9bd-602674406448 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:41.482995 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955655f0-3c70-4485-b992-dbbb232d415c None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:41.524028 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280c000-aab6-4845-a8f4-8bda52c5d9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:41.524869 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280c000-aab6-4845-a8f4-8bda52c5d9b8 None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:41.525078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280c000-aab6-4845-a8f4-8bda52c5d9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:41.525317 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280c000-aab6-4845-a8f4-8bda52c5d9b8 None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:41.526050 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280c000-aab6-4845-a8f4-8bda52c5d9b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:41.527621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280c000-aab6-4845-a8f4-8bda52c5d9b8 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:41.586309 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545cd07-d5ef-4a54-a9bd-602674406448 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:41.627109 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 101/198] 10.222.0.18 () {60 vars in 1132 bytes} [Mon May 2 08:43:41 2022] POST /identity/v3/users => generated 297 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:43:41.637235 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2f354-53a7-4e92-9b26-58f1ffaa585a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:41.638441 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2f354-53a7-4e92-9b26-58f1ffaa585a None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:41.638868 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2f354-53a7-4e92-9b26-58f1ffaa585a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:41.639268 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2f354-53a7-4e92-9b26-58f1ffaa585a None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:41.641276 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2f354-53a7-4e92-9b26-58f1ffaa585a None admin] RBAC: Authorizing `identity:get_project(project_id=8308537c26a949d68d16cd15829ed9e1)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:41.643137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2f354-53a7-4e92-9b26-58f1ffaa585a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:41.645143 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 98/199] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:41 2022] GET /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:41.651538 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280c000-aab6-4845-a8f4-8bda52c5d9b8 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:41.786767 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280c000-aab6-4845-a8f4-8bda52c5d9b8 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:41.827109 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402ec32-f4c6-48a2-ac87-1bd01bcabce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:41.829002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402ec32-f4c6-48a2-ac87-1bd01bcabce9 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:41.829500 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402ec32-f4c6-48a2-ac87-1bd01bcabce9 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:41.829980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402ec32-f4c6-48a2-ac87-1bd01bcabce9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:41.831044 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402ec32-f4c6-48a2-ac87-1bd01bcabce9 None admin] RBAC: Adding query filter params (role.id=b860fb30a96b4b2ea790453a2a4f6044, scope.project.id=8308537c26a949d68d16cd15829ed9e1, user.id=c444ef0325ff4dd1a6c38dad34cf7296) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:41.831567 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402ec32-f4c6-48a2-ac87-1bd01bcabce9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:41.833353 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402ec32-f4c6-48a2-ac87-1bd01bcabce9 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:41.839903 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 102/200] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:43:41 2022] GET /identity/v3/role_assignments?user.id=c444ef0325ff4dd1a6c38dad34cf7296&scope.project.id=8308537c26a949d68d16cd15829ed9e1&role.id=b860fb30a96b4b2ea790453a2a4f6044 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:42.942583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ab7ca-4327-4391-a43c-ebebec0e9768 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:42.943074 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ab7ca-4327-4391-a43c-ebebec0e9768 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:42.943074 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ab7ca-4327-4391-a43c-ebebec0e9768 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:42.944729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 99/201] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:42.950540 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb51ee-3b69-4f23-8c60-d04d064d8434 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:42.950965 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb51ee-3b69-4f23-8c60-d04d064d8434 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:42.951142 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb51ee-3b69-4f23-8c60-d04d064d8434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:42.976197 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-87cb51ee-3b69-4f23-8c60-d04d064d8434 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:42.977374 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-87cb51ee-3b69-4f23-8c60-d04d064d8434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:43.066323 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 103/202] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:43:43.105575 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ab7ca-4327-4391-a43c-ebebec0e9768 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:43.236117 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ab7ca-4327-4391-a43c-ebebec0e9768 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:43.283900 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b9edd-5410-4e6e-98d8-5140f83aebbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:43.285127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b9edd-5410-4e6e-98d8-5140f83aebbb None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:43.285624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b9edd-5410-4e6e-98d8-5140f83aebbb None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:43.286127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b9edd-5410-4e6e-98d8-5140f83aebbb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:43.309076 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b9edd-5410-4e6e-98d8-5140f83aebbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:43.317064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-2b6b9edd-5410-4e6e-98d8-5140f83aebbb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 02 08:43:43.317064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:43.317064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:43.317064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:43.317064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:43.317064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:43.317064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:43.317064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:43.317064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:43.317064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:43.317064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:43.317064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:43.317064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:43.317064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:43.317064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:43.317064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:43.317981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:43.317981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:43.317981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:43.317981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:43.317981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:43.317981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:43.317981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:43.317981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:43.317981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:43.317981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:43.317981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:43.317981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:43:43.317981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:43.317981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:43.317981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:43.317981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:43.318759 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:43.318759 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:43.318759 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:43.318759 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:43.318759 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:43.318759 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:43.318759 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:43.318759 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:43.318759 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:43.318759 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:43.318759 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 02 08:43:43.318759 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:43:43.323264 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 100/203] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:43.325138 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb51ee-3b69-4f23-8c60-d04d064d8434 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:43.539369 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb51ee-3b69-4f23-8c60-d04d064d8434 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:43.584200 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4421b-f25a-492d-b854-743343dad9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:43.584877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4421b-f25a-492d-b854-743343dad9fe None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:43.585158 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4421b-f25a-492d-b854-743343dad9fe None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:43.585432 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4421b-f25a-492d-b854-743343dad9fe None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:43.586181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4421b-f25a-492d-b854-743343dad9fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:43.586489 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4421b-f25a-492d-b854-743343dad9fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:43.587883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4421b-f25a-492d-b854-743343dad9fe None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:43.599616 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 104/204] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:43.605450 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b9edd-5410-4e6e-98d8-5140f83aebbb None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:43.779746 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b9edd-5410-4e6e-98d8-5140f83aebbb None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:43.831096 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5c98c-dd93-4a98-8de3-93f96a635110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:43.832387 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5c98c-dd93-4a98-8de3-93f96a635110 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:43.832901 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5c98c-dd93-4a98-8de3-93f96a635110 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:43.833396 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5c98c-dd93-4a98-8de3-93f96a635110 None admin] PATH_INFO: `/v3/users/e66e85510acf459c8d0989d4d629f514` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:43.836132 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5c98c-dd93-4a98-8de3-93f96a635110 None admin] RBAC: Authorizing `identity:get_user(user_id=e66e85510acf459c8d0989d4d629f514)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:43.838001 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5c98c-dd93-4a98-8de3-93f96a635110 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:43.839993 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 101/205] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:43 2022] GET /identity/v3/users/e66e85510acf459c8d0989d4d629f514 => generated 289 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:43.846854 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4421b-f25a-492d-b854-743343dad9fe None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:43.996473 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4421b-f25a-492d-b854-743343dad9fe None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:44.038418 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc16237-2d26-45c2-9e08-55da3797f873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:44.039071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc16237-2d26-45c2-9e08-55da3797f873 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:44.039352 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc16237-2d26-45c2-9e08-55da3797f873 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:44.039628 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc16237-2d26-45c2-9e08-55da3797f873 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:44.130508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc16237-2d26-45c2-9e08-55da3797f873 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:44.131901 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc16237-2d26-45c2-9e08-55da3797f873 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:44.261451 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c85d3-b479-45cd-89d3-26adb657f2c8 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:44.262521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c85d3-b479-45cd-89d3-26adb657f2c8 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:44.263031 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c85d3-b479-45cd-89d3-26adb657f2c8 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:44.264637 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 102/206] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:44.271267 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 105/207] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:43:44.274216 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fef9ea-c738-493c-b4d2-5bb72db788cb None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:44.274719 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fef9ea-c738-493c-b4d2-5bb72db788cb None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:44.275235 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fef9ea-c738-493c-b4d2-5bb72db788cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:44.276512 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc16237-2d26-45c2-9e08-55da3797f873 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:44.305046 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-28fef9ea-c738-493c-b4d2-5bb72db788cb None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:44.306562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-28fef9ea-c738-493c-b4d2-5bb72db788cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:44.394525 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc16237-2d26-45c2-9e08-55da3797f873 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:44.439930 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b79ce-037c-4691-8d09-895dfafdf68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:44.442022 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b79ce-037c-4691-8d09-895dfafdf68f None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:44.443821 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b79ce-037c-4691-8d09-895dfafdf68f None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:44.444348 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b79ce-037c-4691-8d09-895dfafdf68f None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:44.446659 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b79ce-037c-4691-8d09-895dfafdf68f None admin] RBAC: Authorizing `identity:get_project(project_id=5f507bcdfd314874b0a378d7037ed855)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:44.449424 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b79ce-037c-4691-8d09-895dfafdf68f None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:44.454532 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 106/208] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:44 2022] GET /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:44.462497 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 103/209] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:44.462651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b79ce-037c-4691-8d09-895dfafdf68f None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:44.488926 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fef9ea-c738-493c-b4d2-5bb72db788cb None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:44.608278 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b79ce-037c-4691-8d09-895dfafdf68f None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:44.613808 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fef9ea-c738-493c-b4d2-5bb72db788cb None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:44.646589 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1d515-aef1-4adf-b6bd-23f15a9ff546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:44.647162 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1d515-aef1-4adf-b6bd-23f15a9ff546 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:44.647444 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1d515-aef1-4adf-b6bd-23f15a9ff546 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:44.647867 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1d515-aef1-4adf-b6bd-23f15a9ff546 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:44.648709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1d515-aef1-4adf-b6bd-23f15a9ff546 None admin] RBAC: Adding query filter params (role.id=b6b9080e8c6540ef9103f82c4cc9dc83, scope.project.id=5f507bcdfd314874b0a378d7037ed855, user.id=e66e85510acf459c8d0989d4d629f514) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:44.648973 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1d515-aef1-4adf-b6bd-23f15a9ff546 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:44.650499 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1d515-aef1-4adf-b6bd-23f15a9ff546 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:44.655670 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d5a5f-9836-4ee7-adf7-87e1d6a9b6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:44.661066 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5a5f-9836-4ee7-adf7-87e1d6a9b6fa None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:44.661220 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 107/210] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:43:44 2022] GET /identity/v3/role_assignments?user.id=e66e85510acf459c8d0989d4d629f514&scope.project.id=5f507bcdfd314874b0a378d7037ed855&role.id=b6b9080e8c6540ef9103f82c4cc9dc83 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:44.661299 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5a5f-9836-4ee7-adf7-87e1d6a9b6fa None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:44.661299 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5a5f-9836-4ee7-adf7-87e1d6a9b6fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:44.661439 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b10efc-3a96-4d39-b6e8-a64ebb096187 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:44.661439 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b10efc-3a96-4d39-b6e8-a64ebb096187 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:44.661439 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b10efc-3a96-4d39-b6e8-a64ebb096187 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:44.661439 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 108/211] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:44.665525 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f1551-1e10-4e5e-a48e-97b6e573317d None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:44.665525 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f1551-1e10-4e5e-a48e-97b6e573317d None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:44.665732 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f1551-1e10-4e5e-a48e-97b6e573317d None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:44.668126 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 109/212] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:44.668276 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc59f17-925c-4d1a-a535-523b9ba9f824 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:44.668940 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc59f17-925c-4d1a-a535-523b9ba9f824 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:44.668940 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc59f17-925c-4d1a-a535-523b9ba9f824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:44.681252 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d5a5f-9836-4ee7-adf7-87e1d6a9b6fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:44.690524 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-844d5a5f-9836-4ee7-adf7-87e1d6a9b6fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:43:44.690524 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:44.690524 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:44.690524 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:44.690524 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:44.690524 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:44.690524 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:44.690524 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:44.690524 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:44.690524 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:44.690524 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:44.690524 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:44.690524 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:44.690524 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:44.690524 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:44.690524 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:44.691709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:44.691709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:44.691709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:44.691709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:44.691709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:44.691709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:44.691709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:44.691709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:44.691709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:44.691709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:44.691709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:44.691709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:43:44.691709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:44.691709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:44.691709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:44.691709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:44.693062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:44.693062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:44.693062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:44.693062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:44.693062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:44.693062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:44.693062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:44.693062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:44.693062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:44.693062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:44.693062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:43:44.693062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:43:44.694062 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-7fc59f17-925c-4d1a-a535-523b9ba9f824 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:44.694743 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-7fc59f17-925c-4d1a-a535-523b9ba9f824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:44.696094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 104/213] 10.222.0.18 () {56 vars in 1096 bytes} [Mon May 2 08:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:43:44.697947 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e7a4b-85e1-4608-9a7f-0709994fb73a None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:44.698388 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e7a4b-85e1-4608-9a7f-0709994fb73a None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:44.698803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e7a4b-85e1-4608-9a7f-0709994fb73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:44.717852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-fb6e7a4b-85e1-4608-9a7f-0709994fb73a None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:44.719548 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-fb6e7a4b-85e1-4608-9a7f-0709994fb73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:44.785531 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 110/214] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:44.787297 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc59f17-925c-4d1a-a535-523b9ba9f824 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:44.796229 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 105/215] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:44.798481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a495fc-4682-41af-819a-05b97b8f3179 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:44.798840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a495fc-4682-41af-819a-05b97b8f3179 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:44.799214 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a495fc-4682-41af-819a-05b97b8f3179 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:44.800829 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 106/216] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:44.806431 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdbb63-c9a9-4619-8092-a9cd55380b2b None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:44.806723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdbb63-c9a9-4619-8092-a9cd55380b2b None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:44.807002 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdbb63-c9a9-4619-8092-a9cd55380b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:44.824198 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-01cdbb63-c9a9-4619-8092-a9cd55380b2b None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:44.825402 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-01cdbb63-c9a9-4619-8092-a9cd55380b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:44.904747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 107/217] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:43:44.905720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdbb63-c9a9-4619-8092-a9cd55380b2b None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:44.909480 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc59f17-925c-4d1a-a535-523b9ba9f824 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:44.946570 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fb617-6fca-4c4d-a456-b298f9a1d274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:44.947240 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fb617-6fca-4c4d-a456-b298f9a1d274 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:44.947773 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fb617-6fca-4c4d-a456-b298f9a1d274 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:44.948063 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fb617-6fca-4c4d-a456-b298f9a1d274 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:44.948830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fb617-6fca-4c4d-a456-b298f9a1d274 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:44.950792 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fb617-6fca-4c4d-a456-b298f9a1d274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:44.954529 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fb617-6fca-4c4d-a456-b298f9a1d274 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:44.960948 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 111/218] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:44.961770 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fb617-6fca-4c4d-a456-b298f9a1d274 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:45.011111 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdbb63-c9a9-4619-8092-a9cd55380b2b None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:45.042208 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a682bf-5325-478e-ae45-dcf112bce85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:45.042992 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a682bf-5325-478e-ae45-dcf112bce85d None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:45.043271 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a682bf-5325-478e-ae45-dcf112bce85d None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:45.043540 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a682bf-5325-478e-ae45-dcf112bce85d None admin] PATH_INFO: `/v3/domains/default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:45.044805 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a682bf-5325-478e-ae45-dcf112bce85d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:45.046295 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a682bf-5325-478e-ae45-dcf112bce85d None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:45.048468 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 108/219] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:43:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:45.049304 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a682bf-5325-478e-ae45-dcf112bce85d None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:45.056353 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fb617-6fca-4c4d-a456-b298f9a1d274 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:45.088694 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc44415-cedd-47a0-be2d-68ef7affc664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:45.089596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc44415-cedd-47a0-be2d-68ef7affc664 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:45.089887 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc44415-cedd-47a0-be2d-68ef7affc664 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:45.090159 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc44415-cedd-47a0-be2d-68ef7affc664 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:45.099843 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc44415-cedd-47a0-be2d-68ef7affc664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:45.107809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-2fc44415-cedd-47a0-be2d-68ef7affc664 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:43:45.107809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:45.107809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:45.107809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:45.107809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:45.107809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:45.107809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:45.107809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:45.107809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:45.107809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:45.107809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:45.107809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:45.107809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:45.107809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:45.107809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:45.107809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:45.108816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:45.108816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:45.108816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:45.108816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:45.108816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:45.108816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:45.108816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:45.108816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:45.108816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:45.108816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:45.108816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:45.108816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:45.108816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:45.108816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:45.108816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:45.108816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:45.110323 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:45.110323 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:45.110323 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:45.110323 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:45.110323 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:45.110323 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:45.110323 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:45.110323 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:45.110323 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:45.110323 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:45.110323 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:43:45.110323 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:45.110323 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 112/220] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:43:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:45.111135 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc44415-cedd-47a0-be2d-68ef7affc664 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:45.143080 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a682bf-5325-478e-ae45-dcf112bce85d None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:45.175720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e16b5e-3dc5-4939-9d70-060e0a4223db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:45.176485 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e16b5e-3dc5-4939-9d70-060e0a4223db None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:45.176769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e16b5e-3dc5-4939-9d70-060e0a4223db None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:45.177046 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e16b5e-3dc5-4939-9d70-060e0a4223db None admin] PATH_INFO: `/v3/roles/member` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:45.186751 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e16b5e-3dc5-4939-9d70-060e0a4223db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:45.194611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-25e16b5e-3dc5-4939-9d70-060e0a4223db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:45.194611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:45.194611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:45.194611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:45.194611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:45.194611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:45.194611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:45.194611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:45.194611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:45.194611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:45.194611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:45.194611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:45.194611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:45.194611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:45.194611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:45.194611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:45.195716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:45.195716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:45.195716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:45.195716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:45.195716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:45.195716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:45.195716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:45.195716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:45.195716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:45.195716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:45.195716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:45.195716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:43:45.195716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:45.195716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:45.195716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:45.195716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:45.196577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:45.196577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:45.196577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:45.196577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:45.196577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:45.196577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:45.196577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:45.196577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:45.196577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:45.196577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:45.196577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:45.196577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:43:45.196577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 109/221] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:45.196577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e16b5e-3dc5-4939-9d70-060e0a4223db None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:45.208165 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc44415-cedd-47a0-be2d-68ef7affc664 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:45.240311 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63de454-0abb-4585-92aa-a79f0fe316f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:45.241175 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63de454-0abb-4585-92aa-a79f0fe316f9 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:45.241456 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63de454-0abb-4585-92aa-a79f0fe316f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:45.241726 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63de454-0abb-4585-92aa-a79f0fe316f9 None admin] PATH_INFO: `/v3/users/c444ef0325ff4dd1a6c38dad34cf7296` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:45.242916 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63de454-0abb-4585-92aa-a79f0fe316f9 None admin] RBAC: Authorizing `identity:get_user(user_id=c444ef0325ff4dd1a6c38dad34cf7296)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:45.244405 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63de454-0abb-4585-92aa-a79f0fe316f9 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:45.246038 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 113/222] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:45 2022] GET /identity/v3/users/c444ef0325ff4dd1a6c38dad34cf7296 => generated 283 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:45.246790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63de454-0abb-4585-92aa-a79f0fe316f9 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:45.291575 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e16b5e-3dc5-4939-9d70-060e0a4223db None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:45.323686 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd1908-fabd-4733-95c9-807274476ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:45.324389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd1908-fabd-4733-95c9-807274476ac6 None admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:45.324677 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd1908-fabd-4733-95c9-807274476ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:45.324954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd1908-fabd-4733-95c9-807274476ac6 None admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:45.325664 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd1908-fabd-4733-95c9-807274476ac6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:45.327135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd1908-fabd-4733-95c9-807274476ac6 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:45.340020 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63de454-0abb-4585-92aa-a79f0fe316f9 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:45.371976 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d31c86-3b8b-494c-99dd-37e6878886ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:45.372837 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d31c86-3b8b-494c-99dd-37e6878886ac None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:45.373127 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d31c86-3b8b-494c-99dd-37e6878886ac None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:45.373400 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d31c86-3b8b-494c-99dd-37e6878886ac None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:45.374135 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d31c86-3b8b-494c-99dd-37e6878886ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:45.374441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d31c86-3b8b-494c-99dd-37e6878886ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:45.375939 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d31c86-3b8b-494c-99dd-37e6878886ac None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:45.383469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 114/223] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:43:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:45.387507 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d31c86-3b8b-494c-99dd-37e6878886ac None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:45.439697 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 110/224] 10.222.0.18 () {60 vars in 1132 bytes} [Mon May 2 08:43:45 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:43:45.440983 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd1908-fabd-4733-95c9-807274476ac6 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:45.490098 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d31c86-3b8b-494c-99dd-37e6878886ac None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:45.526036 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c519ad-1157-4a04-9049-26163ca29b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:45.526715 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c519ad-1157-4a04-9049-26163ca29b5b None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:45.527009 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c519ad-1157-4a04-9049-26163ca29b5b None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:45.527285 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c519ad-1157-4a04-9049-26163ca29b5b None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:45.528068 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c519ad-1157-4a04-9049-26163ca29b5b None admin] RBAC: Adding query filter params (name=member) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:45.528394 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c519ad-1157-4a04-9049-26163ca29b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:45.529841 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c519ad-1157-4a04-9049-26163ca29b5b None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:45.539687 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 115/225] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:45.540819 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c519ad-1157-4a04-9049-26163ca29b5b None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:45.560729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd1908-fabd-4733-95c9-807274476ac6 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:45.597647 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594de4f4-d552-449c-80ac-eedceb44af07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:45.598536 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594de4f4-d552-449c-80ac-eedceb44af07 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:45.598820 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594de4f4-d552-449c-80ac-eedceb44af07 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:45.599096 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594de4f4-d552-449c-80ac-eedceb44af07 None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:45.600379 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594de4f4-d552-449c-80ac-eedceb44af07 None admin] RBAC: Authorizing `identity:get_project(project_id=8308537c26a949d68d16cd15829ed9e1)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:45.601918 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594de4f4-d552-449c-80ac-eedceb44af07 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:45.608466 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 111/226] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:45 2022] GET /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:45.608466 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594de4f4-d552-449c-80ac-eedceb44af07 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:45.659006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c519ad-1157-4a04-9049-26163ca29b5b None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:45.693661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2b745-5d1e-4323-924d-9d7d36536b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:45.694464 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2b745-5d1e-4323-924d-9d7d36536b0b None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:45.694749 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2b745-5d1e-4323-924d-9d7d36536b0b None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:45.695027 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2b745-5d1e-4323-924d-9d7d36536b0b None admin] PATH_INFO: `/v3/users/c444ef0325ff4dd1a6c38dad34cf7296` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:45.696279 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2b745-5d1e-4323-924d-9d7d36536b0b None admin] RBAC: Authorizing `identity:get_user(user_id=c444ef0325ff4dd1a6c38dad34cf7296)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:45.697985 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2b745-5d1e-4323-924d-9d7d36536b0b None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:45.699930 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 116/227] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:45 2022] GET /identity/v3/users/c444ef0325ff4dd1a6c38dad34cf7296 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:45.704747 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2b745-5d1e-4323-924d-9d7d36536b0b None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:45.724820 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594de4f4-d552-449c-80ac-eedceb44af07 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:45.767982 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b55774-5afd-4695-b790-2dfd71b05c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:45.768880 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b55774-5afd-4695-b790-2dfd71b05c61 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:45.769158 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b55774-5afd-4695-b790-2dfd71b05c61 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:45.769698 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b55774-5afd-4695-b790-2dfd71b05c61 None admin] PATH_INFO: `/v3/users/6fb674497ef04e1b8067ba6c21a8a55f` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:45.784312 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b55774-5afd-4695-b790-2dfd71b05c61 None admin] RBAC: Authorizing `identity:get_user(user_id=6fb674497ef04e1b8067ba6c21a8a55f)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:45.785806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b55774-5afd-4695-b790-2dfd71b05c61 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:45.787525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 112/228] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:45 2022] GET /identity/v3/users/6fb674497ef04e1b8067ba6c21a8a55f => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:45.792026 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b55774-5afd-4695-b790-2dfd71b05c61 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:45.814288 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2b745-5d1e-4323-924d-9d7d36536b0b None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:45.849209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2f6fd-80bb-4f4b-9ea8-c0e0cded6476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:45.850173 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2f6fd-80bb-4f4b-9ea8-c0e0cded6476 None admin] REQUEST_METHOD: `PUT` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:45.850446 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2f6fd-80bb-4f4b-9ea8-c0e0cded6476 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:45.850746 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2f6fd-80bb-4f4b-9ea8-c0e0cded6476 None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1/users/c444ef0325ff4dd1a6c38dad34cf7296/roles/509216a314244b96b05d3fe56b0d9cd1` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:45.852759 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2f6fd-80bb-4f4b-9ea8-c0e0cded6476 None admin] RBAC: Authorizing `identity:create_grant(project_id=8308537c26a949d68d16cd15829ed9e1, user_id=c444ef0325ff4dd1a6c38dad34cf7296, role_id=509216a314244b96b05d3fe56b0d9cd1)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:45.854455 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2f6fd-80bb-4f4b-9ea8-c0e0cded6476 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:45.899366 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b55774-5afd-4695-b790-2dfd71b05c61 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:45.938216 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d0387-d3e5-4cdc-8c72-1cad5e033872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:45.939472 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d0387-d3e5-4cdc-8c72-1cad5e033872 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:45.939952 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d0387-d3e5-4cdc-8c72-1cad5e033872 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:45.940528 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d0387-d3e5-4cdc-8c72-1cad5e033872 None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:45.941954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d0387-d3e5-4cdc-8c72-1cad5e033872 None admin] RBAC: Authorizing `identity:get_project(project_id=8308537c26a949d68d16cd15829ed9e1)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:45.943636 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d0387-d3e5-4cdc-8c72-1cad5e033872 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:45.945613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 113/229] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:45 2022] GET /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:45.946715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d0387-d3e5-4cdc-8c72-1cad5e033872 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:45.958921 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 117/230] 10.222.0.18 () {58 vars in 1439 bytes} [Mon May 2 08:43:45 2022] PUT /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1/users/c444ef0325ff4dd1a6c38dad34cf7296/roles/509216a314244b96b05d3fe56b0d9cd1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:43:45.965474 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2f6fd-80bb-4f4b-9ea8-c0e0cded6476 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:46.120927 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2f6fd-80bb-4f4b-9ea8-c0e0cded6476 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:46.157847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588ae78-f96a-413c-bd59-3a7a8326feb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:46.158756 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588ae78-f96a-413c-bd59-3a7a8326feb3 None admin] REQUEST_METHOD: `PUT` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:46.159040 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588ae78-f96a-413c-bd59-3a7a8326feb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:46.159319 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588ae78-f96a-413c-bd59-3a7a8326feb3 None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1/users/c444ef0325ff4dd1a6c38dad34cf7296/roles/b860fb30a96b4b2ea790453a2a4f6044` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:46.161631 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588ae78-f96a-413c-bd59-3a7a8326feb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8308537c26a949d68d16cd15829ed9e1, user_id=c444ef0325ff4dd1a6c38dad34cf7296, role_id=b860fb30a96b4b2ea790453a2a4f6044)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:46.163107 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588ae78-f96a-413c-bd59-3a7a8326feb3 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:46.189297 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d0387-d3e5-4cdc-8c72-1cad5e033872 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:46.225430 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ed6de-d6bb-4324-b01b-594f4e81bb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:46.226009 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ed6de-d6bb-4324-b01b-594f4e81bb22 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:46.226292 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ed6de-d6bb-4324-b01b-594f4e81bb22 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:46.226566 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ed6de-d6bb-4324-b01b-594f4e81bb22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:46.263032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 118/231] 10.222.0.18 () {58 vars in 1439 bytes} [Mon May 2 08:43:45 2022] PUT /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1/users/c444ef0325ff4dd1a6c38dad34cf7296/roles/b860fb30a96b4b2ea790453a2a4f6044 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:43:46.313978 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ed6de-d6bb-4324-b01b-594f4e81bb22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:46.315482 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ed6de-d6bb-4324-b01b-594f4e81bb22 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:46.420621 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 114/232] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:43:46.427095 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588ae78-f96a-413c-bd59-3a7a8326feb3 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:46.544130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588ae78-f96a-413c-bd59-3a7a8326feb3 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:46.589760 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351202eb-f04d-4d28-9b15-3971041da393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:46.590622 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351202eb-f04d-4d28-9b15-3971041da393 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:46.590904 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351202eb-f04d-4d28-9b15-3971041da393 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:46.591199 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351202eb-f04d-4d28-9b15-3971041da393 None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:46.596791 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351202eb-f04d-4d28-9b15-3971041da393 None admin] RBAC: Authorizing `identity:get_project(project_id=8308537c26a949d68d16cd15829ed9e1)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:46.598258 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351202eb-f04d-4d28-9b15-3971041da393 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:46.600316 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 119/233] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:46 2022] GET /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:46.605916 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ed6de-d6bb-4324-b01b-594f4e81bb22 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:46.711298 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ed6de-d6bb-4324-b01b-594f4e81bb22 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:46.746030 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f850f71-84a9-46c3-8f9d-f8e0ca25fc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:46.746689 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f850f71-84a9-46c3-8f9d-f8e0ca25fc98 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:46.746969 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f850f71-84a9-46c3-8f9d-f8e0ca25fc98 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:46.747248 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f850f71-84a9-46c3-8f9d-f8e0ca25fc98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:46.748107 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f850f71-84a9-46c3-8f9d-f8e0ca25fc98 None admin] RBAC: Adding query filter params (role.id=722968fb4ca44c1795d61c44f61a78d9, scope.project.id=8308537c26a949d68d16cd15829ed9e1, user.id=6fb674497ef04e1b8067ba6c21a8a55f) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:46.748429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f850f71-84a9-46c3-8f9d-f8e0ca25fc98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:46.750792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f850f71-84a9-46c3-8f9d-f8e0ca25fc98 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:46.757057 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 115/234] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:43:46 2022] GET /identity/v3/role_assignments?user.id=6fb674497ef04e1b8067ba6c21a8a55f&scope.project.id=8308537c26a949d68d16cd15829ed9e1&role.id=722968fb4ca44c1795d61c44f61a78d9 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:48.306768 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfb602-dddc-4b6a-8ef0-d692cacc246b None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:48.306768 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfb602-dddc-4b6a-8ef0-d692cacc246b None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:48.306768 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfb602-dddc-4b6a-8ef0-d692cacc246b None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:48.306768 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 120/235] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:48.313718 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9a063-ee30-4efe-bde1-49b1e9fe2289 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:48.314546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9a063-ee30-4efe-bde1-49b1e9fe2289 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:48.315019 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9a063-ee30-4efe-bde1-49b1e9fe2289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:48.333018 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-cee9a063-ee30-4efe-bde1-49b1e9fe2289 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:48.334546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-cee9a063-ee30-4efe-bde1-49b1e9fe2289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:48.403156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 116/236] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:48.416970 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc70c35-06bf-49a2-8623-007343a37414 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:48.417580 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc70c35-06bf-49a2-8623-007343a37414 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:48.418022 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc70c35-06bf-49a2-8623-007343a37414 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:48.419862 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 121/237] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:48.426335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93fe40-e41b-4962-8358-4fd0b365876d None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:48.426655 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93fe40-e41b-4962-8358-4fd0b365876d None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:48.426908 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93fe40-e41b-4962-8358-4fd0b365876d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:48.431650 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc70c35-06bf-49a2-8623-007343a37414 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:48.461079 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-ee93fe40-e41b-4962-8358-4fd0b365876d None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:48.462563 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-ee93fe40-e41b-4962-8358-4fd0b365876d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:48.548914 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc70c35-06bf-49a2-8623-007343a37414 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:48.583858 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d6b33-86fc-4d8c-8ccb-405ae800c49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:48.584645 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d6b33-86fc-4d8c-8ccb-405ae800c49b None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:48.584985 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d6b33-86fc-4d8c-8ccb-405ae800c49b None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:48.585263 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d6b33-86fc-4d8c-8ccb-405ae800c49b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:48.597359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d6b33-86fc-4d8c-8ccb-405ae800c49b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:48.605476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-600d6b33-86fc-4d8c-8ccb-405ae800c49b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 02 08:43:48.605476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:48.605476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:48.605476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:48.605476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:48.605476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:48.605476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:48.605476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:48.605476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:48.605476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:48.605476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:48.605476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:48.605476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:48.605476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:48.605476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:48.605476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:48.606452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:48.606452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:48.606452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:48.606452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:48.606452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:48.606452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:48.606452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:48.606452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:48.606452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:48.606452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:48.606452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:48.606452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:48.606452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:48.606452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:48.606452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:48.606452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:48.607244 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:48.607244 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:48.607244 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:48.607244 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:48.607244 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:48.607244 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:48.607244 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:48.607244 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:48.607244 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:48.607244 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:48.607244 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 02 08:43:48.607244 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:48.607244 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 122/238] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:48.613000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d6b33-86fc-4d8c-8ccb-405ae800c49b None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:48.618970 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 117/239] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:48.654058 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93fe40-e41b-4962-8358-4fd0b365876d None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:48.723939 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d6b33-86fc-4d8c-8ccb-405ae800c49b None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:48.767950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c368145-7fec-4b3d-bd0c-68c99b3119e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:48.768993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c368145-7fec-4b3d-bd0c-68c99b3119e4 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:48.769481 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c368145-7fec-4b3d-bd0c-68c99b3119e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:48.769981 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c368145-7fec-4b3d-bd0c-68c99b3119e4 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:48.771017 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c368145-7fec-4b3d-bd0c-68c99b3119e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:48.771541 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c368145-7fec-4b3d-bd0c-68c99b3119e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:48.773153 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c368145-7fec-4b3d-bd0c-68c99b3119e4 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:48.790445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 123/240] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:48.797046 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c368145-7fec-4b3d-bd0c-68c99b3119e4 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:48.854865 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93fe40-e41b-4962-8358-4fd0b365876d None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:48.895499 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598b965-0966-4691-ae08-d231a2a8c7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:48.896874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598b965-0966-4691-ae08-d231a2a8c7ae None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:48.897448 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598b965-0966-4691-ae08-d231a2a8c7ae None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:48.897732 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598b965-0966-4691-ae08-d231a2a8c7ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:48.899093 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598b965-0966-4691-ae08-d231a2a8c7ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:48.901390 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598b965-0966-4691-ae08-d231a2a8c7ae None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:48.903340 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 118/241] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:43:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:48.908415 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd0cc0-ffad-4d41-a3cf-99486b0476a7 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:48.908415 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd0cc0-ffad-4d41-a3cf-99486b0476a7 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:48.908415 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd0cc0-ffad-4d41-a3cf-99486b0476a7 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:48.908415 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 119/242] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:48.912459 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd0cc0-ffad-4d41-a3cf-99486b0476a7 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:48.941232 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c368145-7fec-4b3d-bd0c-68c99b3119e4 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:48.982394 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32627600-1b0d-40ea-ade0-5d8cf6b10dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:48.983969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32627600-1b0d-40ea-ade0-5d8cf6b10dd7 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:48.984630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32627600-1b0d-40ea-ade0-5d8cf6b10dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:48.985419 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32627600-1b0d-40ea-ade0-5d8cf6b10dd7 None admin] PATH_INFO: `/v3/users/8cc13a555fe042fe97b778f15de6074a` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:49.005140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32627600-1b0d-40ea-ade0-5d8cf6b10dd7 None admin] RBAC: Authorizing `identity:get_user(user_id=8cc13a555fe042fe97b778f15de6074a)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:49.007559 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32627600-1b0d-40ea-ade0-5d8cf6b10dd7 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:49.010282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 124/243] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:48 2022] GET /identity/v3/users/8cc13a555fe042fe97b778f15de6074a => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:49.011962 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927de01-2c01-4fa9-926f-342434c53fb0 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:49.012415 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927de01-2c01-4fa9-926f-342434c53fb0 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:49.013107 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927de01-2c01-4fa9-926f-342434c53fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:49.028679 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd0cc0-ffad-4d41-a3cf-99486b0476a7 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:49.037254 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-a927de01-2c01-4fa9-926f-342434c53fb0 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:49.039361 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-a927de01-2c01-4fa9-926f-342434c53fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:49.076738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635a295-4b0c-4016-b4b3-5a0ab25d64ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:49.077889 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635a295-4b0c-4016-b4b3-5a0ab25d64ea None admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:49.078325 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635a295-4b0c-4016-b4b3-5a0ab25d64ea None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:49.079644 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635a295-4b0c-4016-b4b3-5a0ab25d64ea None admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:49.080607 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635a295-4b0c-4016-b4b3-5a0ab25d64ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:49.082224 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635a295-4b0c-4016-b4b3-5a0ab25d64ea None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:49.121493 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 125/244] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:49.121493 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927de01-2c01-4fa9-926f-342434c53fb0 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:49.189859 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 120/245] 10.222.0.18 () {60 vars in 1132 bytes} [Mon May 2 08:43:48 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:43:49.191083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635a295-4b0c-4016-b4b3-5a0ab25d64ea None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:49.241442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927de01-2c01-4fa9-926f-342434c53fb0 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:49.282169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e8323-613b-4147-a2c7-45f45a084322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:49.283490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e8323-613b-4147-a2c7-45f45a084322 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:49.284017 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e8323-613b-4147-a2c7-45f45a084322 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:49.284555 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e8323-613b-4147-a2c7-45f45a084322 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:49.325724 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635a295-4b0c-4016-b4b3-5a0ab25d64ea None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:49.364271 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56069490-721f-4546-8a3b-c43f14f639f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:49.365074 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56069490-721f-4546-8a3b-c43f14f639f9 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:49.365363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56069490-721f-4546-8a3b-c43f14f639f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:49.365642 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56069490-721f-4546-8a3b-c43f14f639f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:49.367717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e8323-613b-4147-a2c7-45f45a084322 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:49.369836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e8323-613b-4147-a2c7-45f45a084322 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:49.378178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56069490-721f-4546-8a3b-c43f14f639f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:49.386194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-56069490-721f-4546-8a3b-c43f14f639f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:43:49.386194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:49.386194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:49.386194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:49.386194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:49.386194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:49.386194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:49.386194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:49.386194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:49.386194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:49.386194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:49.386194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:49.386194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:49.386194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:49.386194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:49.386194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:49.387146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:49.387146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:49.387146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:49.387146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:49.387146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:49.387146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:49.387146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:49.387146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:49.387146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:49.387146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:49.387146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:49.387146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:43:49.387146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:49.387146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:49.387146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:49.387146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:49.387937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:49.387937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:49.387937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:49.387937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:49.387937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:49.387937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:49.387937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:49.387937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:49.387937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:49.387937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:49.387937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:43:49.387937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:43:49.387937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 121/246] 10.222.0.18 () {56 vars in 1096 bytes} [Mon May 2 08:43:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:49.389287 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe7ff6-3fc9-48de-8fc3-0f1e8605270a None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:49.389580 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe7ff6-3fc9-48de-8fc3-0f1e8605270a None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:49.389858 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe7ff6-3fc9-48de-8fc3-0f1e8605270a None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:49.392662 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 122/247] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:49.397023 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe7ff6-3fc9-48de-8fc3-0f1e8605270a None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:49.493138 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 126/248] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:43:49.499354 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df867a-d6b1-426f-8f36-d2e64944d638 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:49.499354 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df867a-d6b1-426f-8f36-d2e64944d638 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:49.499354 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df867a-d6b1-426f-8f36-d2e64944d638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:49.522174 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-01df867a-d6b1-426f-8f36-d2e64944d638 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:49.523401 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-01df867a-d6b1-426f-8f36-d2e64944d638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:49.538823 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe7ff6-3fc9-48de-8fc3-0f1e8605270a None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:49.580789 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f704945-540e-458a-9a7d-be711e69b6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:49.581821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f704945-540e-458a-9a7d-be711e69b6ff None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:49.582308 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f704945-540e-458a-9a7d-be711e69b6ff None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:49.582786 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f704945-540e-458a-9a7d-be711e69b6ff None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:49.583764 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f704945-540e-458a-9a7d-be711e69b6ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:49.584330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f704945-540e-458a-9a7d-be711e69b6ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:49.585944 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f704945-540e-458a-9a7d-be711e69b6ff None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:49.595328 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 123/249] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:49.596524 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f704945-540e-458a-9a7d-be711e69b6ff None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:49.615758 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 127/250] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:49.616505 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df867a-d6b1-426f-8f36-d2e64944d638 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:49.729629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f704945-540e-458a-9a7d-be711e69b6ff None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:49.748174 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df867a-d6b1-426f-8f36-d2e64944d638 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:49.765855 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31972e53-ff2f-4ce2-8984-f10211b459a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:49.766732 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31972e53-ff2f-4ce2-8984-f10211b459a4 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:49.767012 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31972e53-ff2f-4ce2-8984-f10211b459a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:49.767282 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31972e53-ff2f-4ce2-8984-f10211b459a4 None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:49.768552 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31972e53-ff2f-4ce2-8984-f10211b459a4 None admin] RBAC: Authorizing `identity:get_project(project_id=8308537c26a949d68d16cd15829ed9e1)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:49.770025 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31972e53-ff2f-4ce2-8984-f10211b459a4 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:49.772102 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 124/251] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:49 2022] GET /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:49.773098 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31972e53-ff2f-4ce2-8984-f10211b459a4 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:49.790119 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3dbe00-01ce-4eab-aac1-7147e2d0b99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:49.791256 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dbe00-01ce-4eab-aac1-7147e2d0b99b None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:49.791538 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dbe00-01ce-4eab-aac1-7147e2d0b99b None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:49.791809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dbe00-01ce-4eab-aac1-7147e2d0b99b None admin] PATH_INFO: `/v3/users/c444ef0325ff4dd1a6c38dad34cf7296` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:49.793469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3dbe00-01ce-4eab-aac1-7147e2d0b99b None admin] RBAC: Authorizing `identity:get_user(user_id=c444ef0325ff4dd1a6c38dad34cf7296)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:49.794944 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3dbe00-01ce-4eab-aac1-7147e2d0b99b None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:49.797248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 128/252] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:49 2022] GET /identity/v3/users/c444ef0325ff4dd1a6c38dad34cf7296 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:49.798552 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb490920-3e6a-4882-a148-84ce0d381ee2 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:49.798993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb490920-3e6a-4882-a148-84ce0d381ee2 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:49.799272 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb490920-3e6a-4882-a148-84ce0d381ee2 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:49.801156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 129/253] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:49.801850 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb490920-3e6a-4882-a148-84ce0d381ee2 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:49.879945 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31972e53-ff2f-4ce2-8984-f10211b459a4 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:49.914875 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1790e-fa36-45d9-995d-e574a558014d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:49.915712 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1790e-fa36-45d9-995d-e574a558014d None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:49.916078 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1790e-fa36-45d9-995d-e574a558014d None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:49.916479 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1790e-fa36-45d9-995d-e574a558014d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:49.926937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1790e-fa36-45d9-995d-e574a558014d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:49.930318 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb490920-3e6a-4882-a148-84ce0d381ee2 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:49.935668 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-2ce1790e-fa36-45d9-995d-e574a558014d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:43:49.935668 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:49.935668 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:49.935668 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:49.935668 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:49.935668 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:49.935668 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:49.935668 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:49.935668 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:49.935668 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:49.935668 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:49.935668 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:49.935668 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:49.935668 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:49.935668 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:49.935668 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:49.936571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:49.936571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:49.936571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:49.936571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:49.936571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:49.936571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:49.936571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:49.936571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:49.936571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:49.936571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:49.936571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:49.936571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:43:49.936571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:49.936571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:49.936571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:49.936571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:49.938046 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:49.938046 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:49.938046 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:49.938046 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:49.938046 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:49.938046 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:49.938046 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:49.938046 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:49.938046 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:49.938046 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:49.938046 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:43:49.938046 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:43:49.942347 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 125/254] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:43:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:49.943216 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1790e-fa36-45d9-995d-e574a558014d None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:49.964562 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b3da4-87e7-4de4-a1f6-38d14c80f93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:49.965207 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b3da4-87e7-4de4-a1f6-38d14c80f93e None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:49.965488 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b3da4-87e7-4de4-a1f6-38d14c80f93e None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:49.965756 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b3da4-87e7-4de4-a1f6-38d14c80f93e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:49.966573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b3da4-87e7-4de4-a1f6-38d14c80f93e None admin] RBAC: Adding query filter params (role.id=b6b9080e8c6540ef9103f82c4cc9dc83, scope.project.id=8308537c26a949d68d16cd15829ed9e1, user.id=8cc13a555fe042fe97b778f15de6074a) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:49.966883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b3da4-87e7-4de4-a1f6-38d14c80f93e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:49.969042 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b3da4-87e7-4de4-a1f6-38d14c80f93e None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:49.974704 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 130/255] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:43:49 2022] GET /identity/v3/role_assignments?user.id=8cc13a555fe042fe97b778f15de6074a&scope.project.id=8308537c26a949d68d16cd15829ed9e1&role.id=b6b9080e8c6540ef9103f82c4cc9dc83 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:49.975939 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2251f-914a-4f22-ac5c-3e6f6cf90dad None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:49.976249 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2251f-914a-4f22-ac5c-3e6f6cf90dad None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:49.976522 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2251f-914a-4f22-ac5c-3e6f6cf90dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:49.993058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-c2c2251f-914a-4f22-ac5c-3e6f6cf90dad None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:49.994223 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-c2c2251f-914a-4f22-ac5c-3e6f6cf90dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:50.049953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1790e-fa36-45d9-995d-e574a558014d None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:50.063827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 131/256] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:50.064709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2251f-914a-4f22-ac5c-3e6f6cf90dad None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:50.093326 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ae8eb-10f3-4638-ae18-c8e409833821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:50.094012 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ae8eb-10f3-4638-ae18-c8e409833821 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:50.094297 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ae8eb-10f3-4638-ae18-c8e409833821 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:50.094574 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ae8eb-10f3-4638-ae18-c8e409833821 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:50.231400 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ae8eb-10f3-4638-ae18-c8e409833821 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:50.232861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ae8eb-10f3-4638-ae18-c8e409833821 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:50.256016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2251f-914a-4f22-ac5c-3e6f6cf90dad None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:50.292903 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ddc97-cfd1-424e-9a7f-2ae0994ce8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:50.293571 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ddc97-cfd1-424e-9a7f-2ae0994ce8e3 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:50.293850 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ddc97-cfd1-424e-9a7f-2ae0994ce8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:50.294120 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ddc97-cfd1-424e-9a7f-2ae0994ce8e3 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:50.294857 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ddc97-cfd1-424e-9a7f-2ae0994ce8e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:50.295159 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ddc97-cfd1-424e-9a7f-2ae0994ce8e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:50.297135 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ddc97-cfd1-424e-9a7f-2ae0994ce8e3 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:50.305218 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 132/257] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:43:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:50.306033 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ddc97-cfd1-424e-9a7f-2ae0994ce8e3 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:50.344334 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 126/258] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:43:50.345216 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ae8eb-10f3-4638-ae18-c8e409833821 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:50.462284 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ddc97-cfd1-424e-9a7f-2ae0994ce8e3 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:50.467458 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ae8eb-10f3-4638-ae18-c8e409833821 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:50.513279 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0b69c-222e-44b4-96b8-268e78dfa0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:50.514484 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0b69c-222e-44b4-96b8-268e78dfa0d1 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:50.515677 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0b69c-222e-44b4-96b8-268e78dfa0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:50.517483 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0b69c-222e-44b4-96b8-268e78dfa0d1 None admin] PATH_INFO: `/v3/users/c444ef0325ff4dd1a6c38dad34cf7296` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:50.519847 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0b69c-222e-44b4-96b8-268e78dfa0d1 None admin] RBAC: Authorizing `identity:get_user(user_id=c444ef0325ff4dd1a6c38dad34cf7296)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:50.522681 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0b69c-222e-44b4-96b8-268e78dfa0d1 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:50.526825 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 127/259] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:50 2022] GET /identity/v3/users/c444ef0325ff4dd1a6c38dad34cf7296 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:50.528827 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0b69c-222e-44b4-96b8-268e78dfa0d1 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:50.534908 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5d37a-3a7d-4b37-9cab-5be7e7c5c438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:50.535981 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5d37a-3a7d-4b37-9cab-5be7e7c5c438 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:50.536504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5d37a-3a7d-4b37-9cab-5be7e7c5c438 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:50.536984 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5d37a-3a7d-4b37-9cab-5be7e7c5c438 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:50.562470 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5d37a-3a7d-4b37-9cab-5be7e7c5c438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:50.572536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-31d5d37a-3a7d-4b37-9cab-5be7e7c5c438 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:50.572536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:50.572536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:50.572536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:50.572536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:50.572536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:50.572536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:50.572536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:50.572536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:50.572536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:50.572536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:50.572536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:50.572536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:50.572536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:50.572536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:50.572536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:50.573428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:50.573428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:50.573428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:50.573428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:50.573428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:50.573428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:50.573428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:50.573428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:50.573428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:50.573428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:50.573428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:50.573428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:50.573428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:50.573428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:50.573428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:50.573428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:50.574219 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:50.574219 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:50.574219 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:50.574219 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:50.574219 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:50.574219 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:50.574219 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:50.574219 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:50.574219 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:50.574219 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:50.574219 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:50.574219 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:50.586152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 133/260] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:50.589210 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5d37a-3a7d-4b37-9cab-5be7e7c5c438 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:50.729789 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5d37a-3a7d-4b37-9cab-5be7e7c5c438 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:50.776155 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0b69c-222e-44b4-96b8-268e78dfa0d1 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:50.779988 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cf99f-e862-4f88-8a7c-86c51623fe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:50.781363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cf99f-e862-4f88-8a7c-86c51623fe82 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:50.782041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cf99f-e862-4f88-8a7c-86c51623fe82 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:50.782670 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cf99f-e862-4f88-8a7c-86c51623fe82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:50.838590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7df37-1f67-4981-a09a-dbf3bc6b45cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:50.839844 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7df37-1f67-4981-a09a-dbf3bc6b45cb None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:50.841521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7df37-1f67-4981-a09a-dbf3bc6b45cb None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:50.842981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7df37-1f67-4981-a09a-dbf3bc6b45cb None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:50.845889 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7df37-1f67-4981-a09a-dbf3bc6b45cb None admin] RBAC: Authorizing `identity:get_project(project_id=8308537c26a949d68d16cd15829ed9e1)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:50.850098 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7df37-1f67-4981-a09a-dbf3bc6b45cb None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:50.852898 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 128/261] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:50 2022] GET /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1 => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:50.853876 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7df37-1f67-4981-a09a-dbf3bc6b45cb None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:50.919542 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cf99f-e862-4f88-8a7c-86c51623fe82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:50.921055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cf99f-e862-4f88-8a7c-86c51623fe82 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:51.020333 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7df37-1f67-4981-a09a-dbf3bc6b45cb None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:51.085644 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e9825-5faa-4250-b22b-72728651d2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:51.086246 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e9825-5faa-4250-b22b-72728651d2d6 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:51.086525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e9825-5faa-4250-b22b-72728651d2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:51.086802 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e9825-5faa-4250-b22b-72728651d2d6 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:51.087550 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e9825-5faa-4250-b22b-72728651d2d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:51.087854 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e9825-5faa-4250-b22b-72728651d2d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:51.089281 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e9825-5faa-4250-b22b-72728651d2d6 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:51.106578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 134/262] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:43:51.107442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cf99f-e862-4f88-8a7c-86c51623fe82 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:51.110412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 129/263] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:51.111128 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e9825-5faa-4250-b22b-72728651d2d6 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:51.220930 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cf99f-e862-4f88-8a7c-86c51623fe82 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:51.255292 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04945309-e1c5-420e-aeb6-3179f791968a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:51.255955 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04945309-e1c5-420e-aeb6-3179f791968a None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:51.256267 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04945309-e1c5-420e-aeb6-3179f791968a None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:51.256544 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04945309-e1c5-420e-aeb6-3179f791968a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:51.257373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04945309-e1c5-420e-aeb6-3179f791968a None admin] RBAC: Adding query filter params (role.id=509216a314244b96b05d3fe56b0d9cd1, scope.project.id=8308537c26a949d68d16cd15829ed9e1, user.id=c444ef0325ff4dd1a6c38dad34cf7296) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:51.257685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04945309-e1c5-420e-aeb6-3179f791968a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:51.259136 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04945309-e1c5-420e-aeb6-3179f791968a None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:51.265221 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 135/264] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:43:51 2022] GET /identity/v3/role_assignments?user.id=c444ef0325ff4dd1a6c38dad34cf7296&scope.project.id=8308537c26a949d68d16cd15829ed9e1&role.id=509216a314244b96b05d3fe56b0d9cd1 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:51.266019 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04945309-e1c5-420e-aeb6-3179f791968a None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:51.341056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e9825-5faa-4250-b22b-72728651d2d6 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:51.403243 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22346da2-ac4e-41ee-b2fc-5a7b8c8a6494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:51.404146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22346da2-ac4e-41ee-b2fc-5a7b8c8a6494 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:51.404431 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22346da2-ac4e-41ee-b2fc-5a7b8c8a6494 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:51.404711 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22346da2-ac4e-41ee-b2fc-5a7b8c8a6494 None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:51.407626 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22346da2-ac4e-41ee-b2fc-5a7b8c8a6494 None admin] RBAC: Authorizing `identity:get_project(project_id=8308537c26a949d68d16cd15829ed9e1)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:51.409156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22346da2-ac4e-41ee-b2fc-5a7b8c8a6494 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:51.410953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 130/265] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:51 2022] GET /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1 => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:51.417513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22346da2-ac4e-41ee-b2fc-5a7b8c8a6494 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:51.462473 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04945309-e1c5-420e-aeb6-3179f791968a None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:51.505719 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de5ad2-318b-4613-9808-a4ec0d059f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:51.506612 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5ad2-318b-4613-9808-a4ec0d059f04 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:51.506890 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5ad2-318b-4613-9808-a4ec0d059f04 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:51.507159 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5ad2-318b-4613-9808-a4ec0d059f04 None admin] PATH_INFO: `/v3/users/6fb674497ef04e1b8067ba6c21a8a55f` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:51.513135 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de5ad2-318b-4613-9808-a4ec0d059f04 None admin] RBAC: Authorizing `identity:get_user(user_id=6fb674497ef04e1b8067ba6c21a8a55f)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:51.514663 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de5ad2-318b-4613-9808-a4ec0d059f04 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:51.522378 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 136/266] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:51 2022] GET /identity/v3/users/6fb674497ef04e1b8067ba6c21a8a55f => generated 297 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:51.527651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de5ad2-318b-4613-9808-a4ec0d059f04 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:51.641204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22346da2-ac4e-41ee-b2fc-5a7b8c8a6494 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:51.708695 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d5472-2938-4759-8e7d-da458207eac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:51.709370 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d5472-2938-4759-8e7d-da458207eac4 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:51.709736 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d5472-2938-4759-8e7d-da458207eac4 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:51.710013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d5472-2938-4759-8e7d-da458207eac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:51.710846 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d5472-2938-4759-8e7d-da458207eac4 None admin] RBAC: Adding query filter params (role.id=b860fb30a96b4b2ea790453a2a4f6044, scope.project.id=8308537c26a949d68d16cd15829ed9e1, user.id=c444ef0325ff4dd1a6c38dad34cf7296) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:51.711336 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d5472-2938-4759-8e7d-da458207eac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:51.714130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d5472-2938-4759-8e7d-da458207eac4 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:51.722949 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 131/267] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:43:51 2022] GET /identity/v3/role_assignments?user.id=c444ef0325ff4dd1a6c38dad34cf7296&scope.project.id=8308537c26a949d68d16cd15829ed9e1&role.id=b860fb30a96b4b2ea790453a2a4f6044 => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:51.730838 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de5ad2-318b-4613-9808-a4ec0d059f04 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:51.783080 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84160a-82ba-449c-a3cf-2817c29afe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:51.783975 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84160a-82ba-449c-a3cf-2817c29afe56 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:51.784287 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84160a-82ba-449c-a3cf-2817c29afe56 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:51.784563 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84160a-82ba-449c-a3cf-2817c29afe56 None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:51.785888 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84160a-82ba-449c-a3cf-2817c29afe56 None admin] RBAC: Authorizing `identity:get_project(project_id=8308537c26a949d68d16cd15829ed9e1)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:51.787359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84160a-82ba-449c-a3cf-2817c29afe56 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:51.789267 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 137/268] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:51 2022] GET /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:51.795278 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d5472-2938-4759-8e7d-da458207eac4 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:51.917817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d5472-2938-4759-8e7d-da458207eac4 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:51.959769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dde505-1d1f-4a57-8c66-374dcf416451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:51.960706 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dde505-1d1f-4a57-8c66-374dcf416451 None admin] REQUEST_METHOD: `PUT` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:51.960988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dde505-1d1f-4a57-8c66-374dcf416451 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:51.961262 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dde505-1d1f-4a57-8c66-374dcf416451 None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1/users/6fb674497ef04e1b8067ba6c21a8a55f/roles/722968fb4ca44c1795d61c44f61a78d9` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:51.963363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dde505-1d1f-4a57-8c66-374dcf416451 None admin] RBAC: Authorizing `identity:create_grant(project_id=8308537c26a949d68d16cd15829ed9e1, user_id=6fb674497ef04e1b8067ba6c21a8a55f, role_id=722968fb4ca44c1795d61c44f61a78d9)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:51.965011 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dde505-1d1f-4a57-8c66-374dcf416451 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:52.083372 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 132/269] 10.222.0.18 () {58 vars in 1439 bytes} [Mon May 2 08:43:51 2022] PUT /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1/users/6fb674497ef04e1b8067ba6c21a8a55f/roles/722968fb4ca44c1795d61c44f61a78d9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:43:52.145173 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cf986-2e71-4730-820b-bd4782d788a0 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:52.145528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cf986-2e71-4730-820b-bd4782d788a0 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:52.145776 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cf986-2e71-4730-820b-bd4782d788a0 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:52.147250 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 138/270] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:52.154384 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb013c3a-acd8-465d-b98b-b90d78587473 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:52.154714 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb013c3a-acd8-465d-b98b-b90d78587473 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:52.154950 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb013c3a-acd8-465d-b98b-b90d78587473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:52.175826 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-fb013c3a-acd8-465d-b98b-b90d78587473 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:52.176997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-fb013c3a-acd8-465d-b98b-b90d78587473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:52.264200 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 133/271] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:52.284239 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cf986-2e71-4730-820b-bd4782d788a0 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:52.291792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97cdd3-9b66-4ddc-98e4-523ead85f47e None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:52.292180 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97cdd3-9b66-4ddc-98e4-523ead85f47e None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:52.292459 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97cdd3-9b66-4ddc-98e4-523ead85f47e None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:52.294174 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 134/272] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:52.301318 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810367f8-c935-402a-af6a-9cdba47eb579 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:52.301633 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810367f8-c935-402a-af6a-9cdba47eb579 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:52.301854 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810367f8-c935-402a-af6a-9cdba47eb579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:52.323557 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-810367f8-c935-402a-af6a-9cdba47eb579 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:52.325149 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-810367f8-c935-402a-af6a-9cdba47eb579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:52.403852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 135/273] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:43:52.444705 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810367f8-c935-402a-af6a-9cdba47eb579 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:52.461395 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cf986-2e71-4730-820b-bd4782d788a0 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:52.509096 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddb138-4488-45fe-8c6b-16ee217e1e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:52.510928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddb138-4488-45fe-8c6b-16ee217e1e66 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:52.511462 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddb138-4488-45fe-8c6b-16ee217e1e66 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:52.511952 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddb138-4488-45fe-8c6b-16ee217e1e66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:52.526394 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddb138-4488-45fe-8c6b-16ee217e1e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:52.537660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-f0ddb138-4488-45fe-8c6b-16ee217e1e66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:52.537660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:52.537660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:52.537660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:52.537660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:52.537660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:52.537660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:52.537660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:52.537660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:52.537660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:52.537660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:52.537660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:52.537660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:52.537660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:52.537660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:52.537660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:52.538548 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:52.538548 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:52.538548 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:52.538548 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:52.538548 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:52.538548 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:52.538548 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:52.538548 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:52.538548 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:52.538548 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:52.538548 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:52.538548 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:52.538548 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:52.538548 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:52.538548 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:52.538548 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:52.539322 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:52.539322 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:52.539322 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:52.539322 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:52.539322 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:52.539322 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:52.539322 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:52.539322 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:52.539322 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:52.539322 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:52.539322 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:52.539322 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:52.542110 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 139/274] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:52.549001 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddb138-4488-45fe-8c6b-16ee217e1e66 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:52.570164 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810367f8-c935-402a-af6a-9cdba47eb579 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:52.606817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dae67-b887-40a6-ab04-521b616e464e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:52.608006 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dae67-b887-40a6-ab04-521b616e464e None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:52.609409 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dae67-b887-40a6-ab04-521b616e464e None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:52.609955 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dae67-b887-40a6-ab04-521b616e464e None admin] PATH_INFO: `/v3/domains/default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:52.611571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dae67-b887-40a6-ab04-521b616e464e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:52.613395 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dae67-b887-40a6-ab04-521b616e464e None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:52.615571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 136/275] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:43:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:52.621378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dae67-b887-40a6-ab04-521b616e464e None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:52.649000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddb138-4488-45fe-8c6b-16ee217e1e66 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:52.683826 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b379fa7-bbb0-4b6a-a2e7-1354941f70a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:52.684550 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b379fa7-bbb0-4b6a-a2e7-1354941f70a6 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:52.684831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b379fa7-bbb0-4b6a-a2e7-1354941f70a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:52.685102 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b379fa7-bbb0-4b6a-a2e7-1354941f70a6 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:52.685863 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b379fa7-bbb0-4b6a-a2e7-1354941f70a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:52.686165 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b379fa7-bbb0-4b6a-a2e7-1354941f70a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:52.688352 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b379fa7-bbb0-4b6a-a2e7-1354941f70a6 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:52.703198 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 140/276] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:52.704515 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b379fa7-bbb0-4b6a-a2e7-1354941f70a6 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:52.736693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dae67-b887-40a6-ab04-521b616e464e None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:52.772752 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b21d5-7b9d-4d79-bed5-ff0e494aa394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:52.773433 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b21d5-7b9d-4d79-bed5-ff0e494aa394 None admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:52.773720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b21d5-7b9d-4d79-bed5-ff0e494aa394 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:52.773997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b21d5-7b9d-4d79-bed5-ff0e494aa394 None admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:52.774714 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b21d5-7b9d-4d79-bed5-ff0e494aa394 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:52.776309 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b21d5-7b9d-4d79-bed5-ff0e494aa394 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:52.805014 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b379fa7-bbb0-4b6a-a2e7-1354941f70a6 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:52.837802 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638b2db-4917-466e-9023-54f0323400f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:52.838660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638b2db-4917-466e-9023-54f0323400f8 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:52.838934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638b2db-4917-466e-9023-54f0323400f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:52.839200 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638b2db-4917-466e-9023-54f0323400f8 None admin] PATH_INFO: `/v3/users/4bc07bd750c542af934d96352708d8df` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:52.852842 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638b2db-4917-466e-9023-54f0323400f8 None admin] RBAC: Authorizing `identity:get_user(user_id=4bc07bd750c542af934d96352708d8df)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:52.854300 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638b2db-4917-466e-9023-54f0323400f8 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:52.855997 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 141/277] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:52 2022] GET /identity/v3/users/4bc07bd750c542af934d96352708d8df => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:52.862950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638b2db-4917-466e-9023-54f0323400f8 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:52.902663 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 137/278] 10.222.0.18 () {60 vars in 1132 bytes} [Mon May 2 08:43:52 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 08:43:52.904448 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f90f6-dcb0-465c-abd6-32a6cfc6481f None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:52.910752 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f90f6-dcb0-465c-abd6-32a6cfc6481f None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:52.910752 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f90f6-dcb0-465c-abd6-32a6cfc6481f None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:52.910752 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 138/279] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:52.912666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b694d4-7cff-493b-a205-e75c258e47d9 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:52.912954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b694d4-7cff-493b-a205-e75c258e47d9 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:52.913238 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b694d4-7cff-493b-a205-e75c258e47d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:52.934832 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-98b694d4-7cff-493b-a205-e75c258e47d9 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:52.936578 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-98b694d4-7cff-493b-a205-e75c258e47d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:52.992248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638b2db-4917-466e-9023-54f0323400f8 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:53.010195 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 139/280] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:53.042071 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b694d4-7cff-493b-a205-e75c258e47d9 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:53.048218 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b32b0-960c-4df9-bca9-10ef1326ebcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:53.048897 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b32b0-960c-4df9-bca9-10ef1326ebcd None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:53.049183 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b32b0-960c-4df9-bca9-10ef1326ebcd None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:53.049458 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b32b0-960c-4df9-bca9-10ef1326ebcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:53.050313 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b32b0-960c-4df9-bca9-10ef1326ebcd None admin] RBAC: Adding query filter params (role.id=722968fb4ca44c1795d61c44f61a78d9, user.id=4bc07bd750c542af934d96352708d8df, scope.system=all) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:53.050690 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b32b0-960c-4df9-bca9-10ef1326ebcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:53.052260 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b32b0-960c-4df9-bca9-10ef1326ebcd None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:53.059854 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 142/281] 10.222.0.18 () {56 vars in 1308 bytes} [Mon May 2 08:43:52 2022] GET /identity/v3/role_assignments?user.id=4bc07bd750c542af934d96352708d8df&scope.system=all&role.id=722968fb4ca44c1795d61c44f61a78d9 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:53.161417 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b694d4-7cff-493b-a205-e75c258e47d9 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:53.198286 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b10db8-cb1b-42ec-92e8-8e1afd8c2a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:53.199102 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b10db8-cb1b-42ec-92e8-8e1afd8c2a54 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:53.199382 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b10db8-cb1b-42ec-92e8-8e1afd8c2a54 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:53.199655 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b10db8-cb1b-42ec-92e8-8e1afd8c2a54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:53.212414 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b10db8-cb1b-42ec-92e8-8e1afd8c2a54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:53.220629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-a6b10db8-cb1b-42ec-92e8-8e1afd8c2a54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 02 08:43:53.220629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:53.220629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:53.220629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:53.220629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:53.220629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:53.220629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:53.220629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:53.220629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:53.220629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:53.220629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:53.220629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:53.220629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:53.220629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:53.220629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:53.220629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:53.221535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:53.221535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:53.221535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:53.221535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:53.221535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:53.221535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:53.221535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:53.221535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:53.221535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:53.221535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:53.221535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:53.221535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:43:53.221535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:53.221535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:53.221535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:53.221535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:53.222322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:53.222322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:53.222322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:53.222322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:53.222322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:53.222322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:53.222322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:53.222322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:53.222322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:53.222322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:53.222322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 02 08:43:53.222322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:43:53.222322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 140/282] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:43:53.229852 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b32b0-960c-4df9-bca9-10ef1326ebcd None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:53.339753 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b32b0-960c-4df9-bca9-10ef1326ebcd None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:53.376027 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9436bd-759d-470a-bb7e-95491554dd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:53.376738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9436bd-759d-470a-bb7e-95491554dd91 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:53.377021 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9436bd-759d-470a-bb7e-95491554dd91 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:53.377296 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9436bd-759d-470a-bb7e-95491554dd91 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:53.378062 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9436bd-759d-470a-bb7e-95491554dd91 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:53.378373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9436bd-759d-470a-bb7e-95491554dd91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:53.379822 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9436bd-759d-470a-bb7e-95491554dd91 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:53.389193 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 143/283] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:53.395136 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b10db8-cb1b-42ec-92e8-8e1afd8c2a54 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:53.502768 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b10db8-cb1b-42ec-92e8-8e1afd8c2a54 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:53.537310 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7027af-cf05-489e-9943-7f59461a3cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:53.538198 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7027af-cf05-489e-9943-7f59461a3cf9 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:53.538486 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7027af-cf05-489e-9943-7f59461a3cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:53.538767 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7027af-cf05-489e-9943-7f59461a3cf9 None admin] PATH_INFO: `/v3/users/8cc13a555fe042fe97b778f15de6074a` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:53.539981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7027af-cf05-489e-9943-7f59461a3cf9 None admin] RBAC: Authorizing `identity:get_user(user_id=8cc13a555fe042fe97b778f15de6074a)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:53.541793 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7027af-cf05-489e-9943-7f59461a3cf9 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:53.543541 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 141/284] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:53 2022] GET /identity/v3/users/8cc13a555fe042fe97b778f15de6074a => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:53.549151 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9436bd-759d-470a-bb7e-95491554dd91 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:53.695493 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9436bd-759d-470a-bb7e-95491554dd91 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:53.729251 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c15043-f6a1-4b74-8f4f-4f7f674a08b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:53.730110 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c15043-f6a1-4b74-8f4f-4f7f674a08b9 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:53.730393 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c15043-f6a1-4b74-8f4f-4f7f674a08b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:53.730668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c15043-f6a1-4b74-8f4f-4f7f674a08b9 None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:53.731860 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c15043-f6a1-4b74-8f4f-4f7f674a08b9 None admin] RBAC: Authorizing `identity:get_project(project_id=8308537c26a949d68d16cd15829ed9e1)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:53.733394 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c15043-f6a1-4b74-8f4f-4f7f674a08b9 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:53.735303 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 144/285] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:53 2022] GET /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:53.741178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7027af-cf05-489e-9943-7f59461a3cf9 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:53.856459 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7027af-cf05-489e-9943-7f59461a3cf9 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:53.889596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c5402-0dac-48b6-baf9-087b1c96a67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:53.891255 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c5402-0dac-48b6-baf9-087b1c96a67a None admin] REQUEST_METHOD: `PUT` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:53.891547 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c5402-0dac-48b6-baf9-087b1c96a67a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:53.891824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c5402-0dac-48b6-baf9-087b1c96a67a None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1/users/8cc13a555fe042fe97b778f15de6074a/roles/b6b9080e8c6540ef9103f82c4cc9dc83` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:53.893846 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c5402-0dac-48b6-baf9-087b1c96a67a None admin] RBAC: Authorizing `identity:create_grant(project_id=8308537c26a949d68d16cd15829ed9e1, user_id=8cc13a555fe042fe97b778f15de6074a, role_id=b6b9080e8c6540ef9103f82c4cc9dc83)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:53.895301 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c5402-0dac-48b6-baf9-087b1c96a67a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:53.983368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 142/286] 10.222.0.18 () {58 vars in 1439 bytes} [Mon May 2 08:43:53 2022] PUT /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1/users/8cc13a555fe042fe97b778f15de6074a/roles/b6b9080e8c6540ef9103f82c4cc9dc83 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:43:54.588949 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d92a89-2ec7-4857-ae30-600ee2f12c90 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:54.589693 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d92a89-2ec7-4857-ae30-600ee2f12c90 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:54.589693 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d92a89-2ec7-4857-ae30-600ee2f12c90 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:54.591219 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 145/287] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:54.597041 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789452b6-bbf5-444f-94fb-83ebb35a21ff None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:54.597550 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789452b6-bbf5-444f-94fb-83ebb35a21ff None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:54.597701 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789452b6-bbf5-444f-94fb-83ebb35a21ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:54.625529 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-789452b6-bbf5-444f-94fb-83ebb35a21ff None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:54.626780 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-789452b6-bbf5-444f-94fb-83ebb35a21ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:54.704152 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 143/288] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:43:54.723494 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d92a89-2ec7-4857-ae30-600ee2f12c90 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:54.829462 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d92a89-2ec7-4857-ae30-600ee2f12c90 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:54.864379 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2346bcc-5fa6-490d-b72d-abe074b23ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:54.865417 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2346bcc-5fa6-490d-b72d-abe074b23ef0 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:54.865881 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2346bcc-5fa6-490d-b72d-abe074b23ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:54.866299 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2346bcc-5fa6-490d-b72d-abe074b23ef0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:54.880985 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2346bcc-5fa6-490d-b72d-abe074b23ef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:54.888957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-f2346bcc-5fa6-490d-b72d-abe074b23ef0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:54.888957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:54.888957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:54.888957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:54.888957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:54.888957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:54.888957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:54.888957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:54.888957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:54.888957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:54.888957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:54.888957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:54.888957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:54.888957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:54.888957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:54.888957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:54.890658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:54.890658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:54.890658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:54.890658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:54.890658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:54.890658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:54.890658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:54.890658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:54.890658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:54.890658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:54.890658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:54.890658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:54.890658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:54.890658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:54.890658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:54.890658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:54.891669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:54.891669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:54.891669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:54.891669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:54.891669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:54.891669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:54.891669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:54.891669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:54.891669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:54.891669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:54.891669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:54.891669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:54.893668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 146/289] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:54.899730 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789452b6-bbf5-444f-94fb-83ebb35a21ff None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:55.026441 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789452b6-bbf5-444f-94fb-83ebb35a21ff None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:55.073983 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfeeaf-6cdd-4df3-bb9f-bb2cd93e690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:55.074945 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfeeaf-6cdd-4df3-bb9f-bb2cd93e690e None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:55.075374 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfeeaf-6cdd-4df3-bb9f-bb2cd93e690e None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:55.075792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfeeaf-6cdd-4df3-bb9f-bb2cd93e690e None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:55.076715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfeeaf-6cdd-4df3-bb9f-bb2cd93e690e None admin] RBAC: Adding query filter params (name=member) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:55.077248 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfeeaf-6cdd-4df3-bb9f-bb2cd93e690e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:55.078861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfeeaf-6cdd-4df3-bb9f-bb2cd93e690e None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:55.092150 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 144/290] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:55.094629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2346bcc-5fa6-490d-b72d-abe074b23ef0 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:55.200060 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2346bcc-5fa6-490d-b72d-abe074b23ef0 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:55.246607 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df06ae5-09c0-41c8-a429-6c1046449b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:55.247483 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df06ae5-09c0-41c8-a429-6c1046449b35 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:55.247761 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df06ae5-09c0-41c8-a429-6c1046449b35 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:55.248028 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df06ae5-09c0-41c8-a429-6c1046449b35 None admin] PATH_INFO: `/v3/users/6fb674497ef04e1b8067ba6c21a8a55f` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:55.249339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df06ae5-09c0-41c8-a429-6c1046449b35 None admin] RBAC: Authorizing `identity:get_user(user_id=6fb674497ef04e1b8067ba6c21a8a55f)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:55.250786 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df06ae5-09c0-41c8-a429-6c1046449b35 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:55.252742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 147/291] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:55 2022] GET /identity/v3/users/6fb674497ef04e1b8067ba6c21a8a55f => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:55.258316 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfeeaf-6cdd-4df3-bb9f-bb2cd93e690e None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:55.378747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfeeaf-6cdd-4df3-bb9f-bb2cd93e690e None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:55.412240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54a6ba-012d-48ca-b0c8-db8f699cfbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:55.412899 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54a6ba-012d-48ca-b0c8-db8f699cfbb7 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:55.413180 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54a6ba-012d-48ca-b0c8-db8f699cfbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:55.413450 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54a6ba-012d-48ca-b0c8-db8f699cfbb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:55.481753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54a6ba-012d-48ca-b0c8-db8f699cfbb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:55.483152 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54a6ba-012d-48ca-b0c8-db8f699cfbb7 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:55.587598 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 145/292] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:43:55.593791 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df06ae5-09c0-41c8-a429-6c1046449b35 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:55.703718 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df06ae5-09c0-41c8-a429-6c1046449b35 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:55.743202 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d2865-112c-489f-84d3-97c2300c515c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:55.744446 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d2865-112c-489f-84d3-97c2300c515c None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:55.744955 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d2865-112c-489f-84d3-97c2300c515c None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:55.745411 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d2865-112c-489f-84d3-97c2300c515c None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:55.746890 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d2865-112c-489f-84d3-97c2300c515c None admin] RBAC: Authorizing `identity:get_project(project_id=8308537c26a949d68d16cd15829ed9e1)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:55.748592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d2865-112c-489f-84d3-97c2300c515c None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:55.756210 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 148/293] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:55 2022] GET /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:55.761155 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54a6ba-012d-48ca-b0c8-db8f699cfbb7 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:55.782729 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de9fc2-b6bb-4a44-96d9-b368e7158862 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:55.783044 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de9fc2-b6bb-4a44-96d9-b368e7158862 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:55.783261 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de9fc2-b6bb-4a44-96d9-b368e7158862 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:55.785842 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 149/294] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:55.792123 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa1ca1-40b0-4861-b882-167bc1aadfd6 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:55.792123 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa1ca1-40b0-4861-b882-167bc1aadfd6 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:55.792123 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa1ca1-40b0-4861-b882-167bc1aadfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:55.821524 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-4dfa1ca1-40b0-4861-b882-167bc1aadfd6 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:55.822966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-4dfa1ca1-40b0-4861-b882-167bc1aadfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:55.932661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 150/295] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:43:55.937376 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea90ec-41b7-4804-907a-16f919fd0ba6 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:55.937663 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea90ec-41b7-4804-907a-16f919fd0ba6 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:55.937940 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea90ec-41b7-4804-907a-16f919fd0ba6 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:55.939356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 151/296] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:55.945390 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4aefb2-78d0-4ffb-809c-85dadd9cfbd8 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:55.945678 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4aefb2-78d0-4ffb-809c-85dadd9cfbd8 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:55.945954 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4aefb2-78d0-4ffb-809c-85dadd9cfbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:55.948624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54a6ba-012d-48ca-b0c8-db8f699cfbb7 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:55.967495 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-fd4aefb2-78d0-4ffb-809c-85dadd9cfbd8 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:55.968803 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-fd4aefb2-78d0-4ffb-809c-85dadd9cfbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:55.994086 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e90c6-3fa1-4f39-bafb-b1013622ba95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:55.994887 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e90c6-3fa1-4f39-bafb-b1013622ba95 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:55.995171 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e90c6-3fa1-4f39-bafb-b1013622ba95 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:55.995780 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e90c6-3fa1-4f39-bafb-b1013622ba95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:55.997064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e90c6-3fa1-4f39-bafb-b1013622ba95 None admin] RBAC: Adding query filter params (role.id=722968fb4ca44c1795d61c44f61a78d9, scope.project.id=8308537c26a949d68d16cd15829ed9e1, user.id=6fb674497ef04e1b8067ba6c21a8a55f) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:55.997545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e90c6-3fa1-4f39-bafb-b1013622ba95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:56.000414 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e90c6-3fa1-4f39-bafb-b1013622ba95 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:56.007392 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 146/297] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:43:55 2022] GET /identity/v3/role_assignments?user.id=6fb674497ef04e1b8067ba6c21a8a55f&scope.project.id=8308537c26a949d68d16cd15829ed9e1&role.id=722968fb4ca44c1795d61c44f61a78d9 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:56.008228 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e90c6-3fa1-4f39-bafb-b1013622ba95 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:56.036231 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 152/298] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:56.059869 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4aefb2-78d0-4ffb-809c-85dadd9cfbd8 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:56.141513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e90c6-3fa1-4f39-bafb-b1013622ba95 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:56.183557 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99d130-373d-4678-8026-90c3948ea12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:56.184412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99d130-373d-4678-8026-90c3948ea12b None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:56.184694 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99d130-373d-4678-8026-90c3948ea12b None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:56.184966 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99d130-373d-4678-8026-90c3948ea12b None admin] PATH_INFO: `/v3/roles/member` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:56.211036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99d130-373d-4678-8026-90c3948ea12b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:56.226533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-2a99d130-373d-4678-8026-90c3948ea12b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:56.226533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:56.226533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:56.226533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:56.226533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:56.226533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:56.226533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:56.226533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:56.226533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:56.226533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:56.226533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:56.226533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:56.226533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:56.226533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:56.226533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:56.226533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:56.227481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:56.227481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:56.227481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:56.227481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:56.227481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:56.227481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:56.227481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:56.227481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:56.227481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:56.227481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:56.227481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:56.227481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:43:56.227481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:56.227481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:56.227481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:56.227481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:56.228396 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:56.228396 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:56.228396 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:56.228396 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:56.228396 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:56.228396 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:56.228396 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:56.228396 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:56.228396 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:56.228396 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:56.228396 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:56.228396 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:43:56.229513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 147/299] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:56.236911 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99d130-373d-4678-8026-90c3948ea12b None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:56.271507 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4aefb2-78d0-4ffb-809c-85dadd9cfbd8 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:56.308798 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062c7d2-a67b-4c03-8778-cd5282ff6963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:56.309606 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062c7d2-a67b-4c03-8778-cd5282ff6963 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:56.309893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062c7d2-a67b-4c03-8778-cd5282ff6963 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:56.310165 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062c7d2-a67b-4c03-8778-cd5282ff6963 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:56.311484 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062c7d2-a67b-4c03-8778-cd5282ff6963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:56.312867 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062c7d2-a67b-4c03-8778-cd5282ff6963 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:56.314809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 153/300] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:43:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:56.316066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f8ffd-5d60-40a5-a1d0-b50db41e0ac3 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:56.320101 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f8ffd-5d60-40a5-a1d0-b50db41e0ac3 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:56.320101 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f8ffd-5d60-40a5-a1d0-b50db41e0ac3 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:56.320101 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 154/301] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:56.321990 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f8ffd-5d60-40a5-a1d0-b50db41e0ac3 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:56.360549 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99d130-373d-4678-8026-90c3948ea12b None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:56.398816 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde2b36-c3b0-4bf9-85f8-e0d3b935e06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:56.399789 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde2b36-c3b0-4bf9-85f8-e0d3b935e06e None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:56.400294 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde2b36-c3b0-4bf9-85f8-e0d3b935e06e None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:56.400811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde2b36-c3b0-4bf9-85f8-e0d3b935e06e None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:56.401832 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde2b36-c3b0-4bf9-85f8-e0d3b935e06e None admin] RBAC: Adding query filter params (name=member) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:56.402024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde2b36-c3b0-4bf9-85f8-e0d3b935e06e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:56.403443 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde2b36-c3b0-4bf9-85f8-e0d3b935e06e None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:56.416499 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 148/302] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:56.416499 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db040bd1-013a-4a0b-a5b5-dc9af5fea34d None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:56.416499 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db040bd1-013a-4a0b-a5b5-dc9af5fea34d None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:56.416499 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db040bd1-013a-4a0b-a5b5-dc9af5fea34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:56.431667 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-db040bd1-013a-4a0b-a5b5-dc9af5fea34d None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:56.432869 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-db040bd1-013a-4a0b-a5b5-dc9af5fea34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:56.437445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f8ffd-5d60-40a5-a1d0-b50db41e0ac3 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:56.473607 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a98427-e660-4cf0-9d40-4c9175b1526a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:56.474276 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a98427-e660-4cf0-9d40-4c9175b1526a None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:56.474970 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a98427-e660-4cf0-9d40-4c9175b1526a None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:56.475251 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a98427-e660-4cf0-9d40-4c9175b1526a None admin] PATH_INFO: `/v3/groups` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:56.475951 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a98427-e660-4cf0-9d40-4c9175b1526a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:56.478103 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a98427-e660-4cf0-9d40-4c9175b1526a None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:56.499735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 149/303] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:56.500602 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db040bd1-013a-4a0b-a5b5-dc9af5fea34d None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:56.553271 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 155/304] 10.222.0.18 () {60 vars in 1134 bytes} [Mon May 2 08:43:56 2022] POST /identity/v3/groups => generated 229 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 08:43:56.553271 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a98427-e660-4cf0-9d40-4c9175b1526a None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:56.611209 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db040bd1-013a-4a0b-a5b5-dc9af5fea34d None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:56.649536 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b82d8-fe9b-4b2a-800d-bac599b3dfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:56.650498 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b82d8-fe9b-4b2a-800d-bac599b3dfbc None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:56.650782 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b82d8-fe9b-4b2a-800d-bac599b3dfbc None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:56.651054 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b82d8-fe9b-4b2a-800d-bac599b3dfbc None admin] PATH_INFO: `/v3/users/4bc07bd750c542af934d96352708d8df` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:56.652473 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b82d8-fe9b-4b2a-800d-bac599b3dfbc None admin] RBAC: Authorizing `identity:get_user(user_id=4bc07bd750c542af934d96352708d8df)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:56.653999 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b82d8-fe9b-4b2a-800d-bac599b3dfbc None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:56.656978 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 150/305] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:56 2022] GET /identity/v3/users/4bc07bd750c542af934d96352708d8df => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:56.668104 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b82d8-fe9b-4b2a-800d-bac599b3dfbc None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:56.682727 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a98427-e660-4cf0-9d40-4c9175b1526a None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:56.721035 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fc55d-d8c6-422e-8188-694ac70161df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:56.722058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fc55d-d8c6-422e-8188-694ac70161df None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:56.722168 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fc55d-d8c6-422e-8188-694ac70161df None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:56.722441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fc55d-d8c6-422e-8188-694ac70161df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:56.735252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665fc55d-d8c6-422e-8188-694ac70161df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:56.743295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-665fc55d-d8c6-422e-8188-694ac70161df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 02 08:43:56.743295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:56.743295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:56.743295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:56.743295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:56.743295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:56.743295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:56.743295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:56.743295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:56.743295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:56.743295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:56.743295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:56.743295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:56.743295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:56.743295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:56.743295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:56.744255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:56.744255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:56.744255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:56.744255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:56.744255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:56.744255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:56.744255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:56.744255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:56.744255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:56.744255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:56.744255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:56.744255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:56.744255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:56.744255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:56.744255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:56.744255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:56.745031 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:56.745031 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:56.745031 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:56.745031 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:56.745031 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:56.745031 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:56.745031 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:56.745031 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:56.745031 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:56.745031 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:56.745031 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 02 08:43:56.745031 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:56.745031 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 156/306] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:56.750936 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fc55d-d8c6-422e-8188-694ac70161df None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:56.789088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b82d8-fe9b-4b2a-800d-bac599b3dfbc None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:56.832421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae1880-3206-4c92-a9b5-adbf8d74ee38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:56.833252 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae1880-3206-4c92-a9b5-adbf8d74ee38 None admin] REQUEST_METHOD: `PUT` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:56.833534 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae1880-3206-4c92-a9b5-adbf8d74ee38 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:56.833808 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae1880-3206-4c92-a9b5-adbf8d74ee38 None admin] PATH_INFO: `/v3/system/users/4bc07bd750c542af934d96352708d8df/roles/722968fb4ca44c1795d61c44f61a78d9` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:56.835565 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae1880-3206-4c92-a9b5-adbf8d74ee38 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4bc07bd750c542af934d96352708d8df, role_id=722968fb4ca44c1795d61c44f61a78d9)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:56.836752 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae1880-3206-4c92-a9b5-adbf8d74ee38 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:56.868745 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fc55d-d8c6-422e-8188-694ac70161df None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:56.902847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d0f59-595b-481c-9c5e-74f140a079fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:56.903566 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d0f59-595b-481c-9c5e-74f140a079fc None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:56.903852 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d0f59-595b-481c-9c5e-74f140a079fc None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:56.904166 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d0f59-595b-481c-9c5e-74f140a079fc None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:56.904916 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d0f59-595b-481c-9c5e-74f140a079fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:56.905252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d0f59-595b-481c-9c5e-74f140a079fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:56.906869 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d0f59-595b-481c-9c5e-74f140a079fc None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:56.915305 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 157/307] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:56.920685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d0f59-595b-481c-9c5e-74f140a079fc None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:56.944087 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 151/308] 10.222.0.18 () {58 vars in 1334 bytes} [Mon May 2 08:43:56 2022] PUT /identity/v3/system/users/4bc07bd750c542af934d96352708d8df/roles/722968fb4ca44c1795d61c44f61a78d9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:43:57.040279 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d0f59-595b-481c-9c5e-74f140a079fc None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:57.075487 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390e685-c4d5-41b3-837c-793e51976172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:57.076402 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390e685-c4d5-41b3-837c-793e51976172 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:57.076681 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390e685-c4d5-41b3-837c-793e51976172 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:57.076957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390e685-c4d5-41b3-837c-793e51976172 None admin] PATH_INFO: `/v3/users/52a3b607dfdb4b4192a896ac2e59ae3c` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:57.094077 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390e685-c4d5-41b3-837c-793e51976172 None admin] RBAC: Authorizing `identity:get_user(user_id=52a3b607dfdb4b4192a896ac2e59ae3c)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:57.095584 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390e685-c4d5-41b3-837c-793e51976172 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:57.097936 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 158/309] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:56 2022] GET /identity/v3/users/52a3b607dfdb4b4192a896ac2e59ae3c => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:43:57.103956 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae1880-3206-4c92-a9b5-adbf8d74ee38 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:57.212004 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae1880-3206-4c92-a9b5-adbf8d74ee38 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:57.246108 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6870f8-1bc9-4779-9e0c-c641de332bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:57.246768 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6870f8-1bc9-4779-9e0c-c641de332bf3 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:57.247051 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6870f8-1bc9-4779-9e0c-c641de332bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:57.247325 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6870f8-1bc9-4779-9e0c-c641de332bf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:57.248216 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6870f8-1bc9-4779-9e0c-c641de332bf3 None admin] RBAC: Adding query filter params (role.id=b6b9080e8c6540ef9103f82c4cc9dc83, user.id=52a3b607dfdb4b4192a896ac2e59ae3c, scope.system=all) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:57.248522 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6870f8-1bc9-4779-9e0c-c641de332bf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:57.250109 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6870f8-1bc9-4779-9e0c-c641de332bf3 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:57.255643 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 152/310] 10.222.0.18 () {56 vars in 1308 bytes} [Mon May 2 08:43:57 2022] GET /identity/v3/role_assignments?user.id=52a3b607dfdb4b4192a896ac2e59ae3c&scope.system=all&role.id=b6b9080e8c6540ef9103f82c4cc9dc83 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:57.286878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c0754-2cf0-46ec-ae99-af1843d322b1 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:57.287195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c0754-2cf0-46ec-ae99-af1843d322b1 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:57.287425 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c0754-2cf0-46ec-ae99-af1843d322b1 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:57.289120 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 159/311] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:57.294832 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e471531-d4ac-4064-97e7-1ab0d1a60ada None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:57.295137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e471531-d4ac-4064-97e7-1ab0d1a60ada None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:57.295403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e471531-d4ac-4064-97e7-1ab0d1a60ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:57.313666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-6e471531-d4ac-4064-97e7-1ab0d1a60ada None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:57.314872 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-6e471531-d4ac-4064-97e7-1ab0d1a60ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:57.386244 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 153/312] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:57.411364 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c0754-2cf0-46ec-ae99-af1843d322b1 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:57.517385 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c0754-2cf0-46ec-ae99-af1843d322b1 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:57.550486 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8ae52-ec0d-431f-a615-9bb7cef3239e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:57.551273 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8ae52-ec0d-431f-a615-9bb7cef3239e None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:57.551604 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8ae52-ec0d-431f-a615-9bb7cef3239e None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:57.551882 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8ae52-ec0d-431f-a615-9bb7cef3239e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:57.562859 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8ae52-ec0d-431f-a615-9bb7cef3239e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:57.570666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-dfe8ae52-ec0d-431f-a615-9bb7cef3239e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 02 08:43:57.570666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:57.570666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:57.570666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:57.570666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:57.570666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:57.570666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:57.570666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:57.570666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:57.570666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:57.570666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:57.570666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:57.570666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:57.570666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:57.570666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:57.570666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:57.571535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:57.571535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:57.571535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:57.571535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:57.571535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:57.571535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:57.571535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:57.571535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:57.571535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:57.571535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:57.571535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:57.571535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:57.571535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:57.571535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:57.571535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:57.571535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:57.572831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:57.572831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:57.572831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:57.572831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:57.572831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:57.572831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:57.572831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:57.572831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:57.572831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:57.572831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:57.572831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 02 08:43:57.572831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:57.572831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 160/313] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:57.581472 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e471531-d4ac-4064-97e7-1ab0d1a60ada None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:57.683169 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e471531-d4ac-4064-97e7-1ab0d1a60ada None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:57.716944 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e953189-9e15-448a-a54c-94b4ee33a713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:57.717643 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e953189-9e15-448a-a54c-94b4ee33a713 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:57.718015 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e953189-9e15-448a-a54c-94b4ee33a713 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:57.718331 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e953189-9e15-448a-a54c-94b4ee33a713 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:57.719141 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e953189-9e15-448a-a54c-94b4ee33a713 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:57.719449 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e953189-9e15-448a-a54c-94b4ee33a713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:57.720974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e953189-9e15-448a-a54c-94b4ee33a713 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:57.729730 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 154/314] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:57.735590 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8ae52-ec0d-431f-a615-9bb7cef3239e None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:57.838737 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8ae52-ec0d-431f-a615-9bb7cef3239e None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:57.872651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57648b-f7bc-4288-84c8-eba9aa1514b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:57.873519 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57648b-f7bc-4288-84c8-eba9aa1514b9 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:57.873804 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57648b-f7bc-4288-84c8-eba9aa1514b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:57.874429 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57648b-f7bc-4288-84c8-eba9aa1514b9 None admin] PATH_INFO: `/v3/users/8cc13a555fe042fe97b778f15de6074a` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:57.875681 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57648b-f7bc-4288-84c8-eba9aa1514b9 None admin] RBAC: Authorizing `identity:get_user(user_id=8cc13a555fe042fe97b778f15de6074a)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:57.877210 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57648b-f7bc-4288-84c8-eba9aa1514b9 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:57.879167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 161/315] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:57 2022] GET /identity/v3/users/8cc13a555fe042fe97b778f15de6074a => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:57.884621 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e953189-9e15-448a-a54c-94b4ee33a713 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:57.985070 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e953189-9e15-448a-a54c-94b4ee33a713 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:58.018586 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf5351-ed42-4b03-b931-6f6bd731bdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:58.022913 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf5351-ed42-4b03-b931-6f6bd731bdff None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:58.022913 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf5351-ed42-4b03-b931-6f6bd731bdff None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:58.022913 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf5351-ed42-4b03-b931-6f6bd731bdff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:58.088149 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf5351-ed42-4b03-b931-6f6bd731bdff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:58.089629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf5351-ed42-4b03-b931-6f6bd731bdff None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:58.189303 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 155/316] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:43:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:43:58.194960 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57648b-f7bc-4288-84c8-eba9aa1514b9 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:58.299064 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57648b-f7bc-4288-84c8-eba9aa1514b9 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:58.332418 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c9225-faf2-4bad-91c5-8c81fe9d987f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:58.333265 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c9225-faf2-4bad-91c5-8c81fe9d987f None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:58.333539 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c9225-faf2-4bad-91c5-8c81fe9d987f None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:58.333806 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c9225-faf2-4bad-91c5-8c81fe9d987f None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:58.334980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c9225-faf2-4bad-91c5-8c81fe9d987f None admin] RBAC: Authorizing `identity:get_project(project_id=8308537c26a949d68d16cd15829ed9e1)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:58.336457 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c9225-faf2-4bad-91c5-8c81fe9d987f None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:58.338441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 162/317] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:43:58 2022] GET /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:58.344219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf5351-ed42-4b03-b931-6f6bd731bdff None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:58.443352 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf5351-ed42-4b03-b931-6f6bd731bdff None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:58.478460 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc895ca3-db48-40a8-831f-9f49fd178752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:58.479467 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc895ca3-db48-40a8-831f-9f49fd178752 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:58.479985 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc895ca3-db48-40a8-831f-9f49fd178752 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:58.480490 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc895ca3-db48-40a8-831f-9f49fd178752 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:58.481536 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc895ca3-db48-40a8-831f-9f49fd178752 None admin] RBAC: Adding query filter params (role.id=b6b9080e8c6540ef9103f82c4cc9dc83, scope.project.id=8308537c26a949d68d16cd15829ed9e1, user.id=8cc13a555fe042fe97b778f15de6074a) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:58.482070 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc895ca3-db48-40a8-831f-9f49fd178752 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:58.484422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc895ca3-db48-40a8-831f-9f49fd178752 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:58.490909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 156/318] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:43:58 2022] GET /identity/v3/role_assignments?user.id=8cc13a555fe042fe97b778f15de6074a&scope.project.id=8308537c26a949d68d16cd15829ed9e1&role.id=b6b9080e8c6540ef9103f82c4cc9dc83 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:58.960693 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bf6eb-6be1-4630-b87f-d663e20ac47d None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:58.961183 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bf6eb-6be1-4630-b87f-d663e20ac47d None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:58.961183 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bf6eb-6be1-4630-b87f-d663e20ac47d None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:58.962647 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 163/319] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:43:58.968204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357549a0-450a-4a75-bc9a-37c535146fe5 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:58.968588 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357549a0-450a-4a75-bc9a-37c535146fe5 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:58.968771 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357549a0-450a-4a75-bc9a-37c535146fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:58.985658 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-357549a0-450a-4a75-bc9a-37c535146fe5 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:58.986847 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-357549a0-450a-4a75-bc9a-37c535146fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:59.051554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 157/320] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:43:59.076796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bf6eb-6be1-4630-b87f-d663e20ac47d None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:59.177238 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bf6eb-6be1-4630-b87f-d663e20ac47d None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:59.210586 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ede20-fc19-41a3-bebf-f1472194d105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:59.211542 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ede20-fc19-41a3-bebf-f1472194d105 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:59.211780 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ede20-fc19-41a3-bebf-f1472194d105 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:59.212073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ede20-fc19-41a3-bebf-f1472194d105 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:59.213339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ede20-fc19-41a3-bebf-f1472194d105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:59.214903 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ede20-fc19-41a3-bebf-f1472194d105 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:59.216905 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 164/321] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:43:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:59.223426 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357549a0-450a-4a75-bc9a-37c535146fe5 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:59.330551 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357549a0-450a-4a75-bc9a-37c535146fe5 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:59.362947 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c59745-967c-4d0e-ad25-95aed608d49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:59.364190 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c59745-967c-4d0e-ad25-95aed608d49e None admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:59.364190 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c59745-967c-4d0e-ad25-95aed608d49e None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:59.364190 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c59745-967c-4d0e-ad25-95aed608d49e None admin] PATH_INFO: `/v3/groups` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:59.364891 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c59745-967c-4d0e-ad25-95aed608d49e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:59.366332 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c59745-967c-4d0e-ad25-95aed608d49e None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:59.411604 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2417d-add3-4557-b629-261913548d6f None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:59.412022 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2417d-add3-4557-b629-261913548d6f None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:59.412361 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2417d-add3-4557-b629-261913548d6f None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:59.413720 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 165/322] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:43:59.418651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd3276-e51f-45fc-9651-efe728cbd667 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:59.418992 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd3276-e51f-45fc-9651-efe728cbd667 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:59.419278 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd3276-e51f-45fc-9651-efe728cbd667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:59.437369 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-1bcd3276-e51f-45fc-9651-efe728cbd667 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:59.438538 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-1bcd3276-e51f-45fc-9651-efe728cbd667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:59.451642 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 158/323] 10.222.0.18 () {60 vars in 1134 bytes} [Mon May 2 08:43:59 2022] POST /identity/v3/groups => generated 226 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:43:59.530565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 166/324] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:43:59.554957 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c59745-967c-4d0e-ad25-95aed608d49e None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:59.651019 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07743c-4f57-4328-abd5-1d34a41c927e None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:59.651546 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07743c-4f57-4328-abd5-1d34a41c927e None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:59.651822 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07743c-4f57-4328-abd5-1d34a41c927e None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:59.653219 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 167/325] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:43:59.658922 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cec72d-44c0-4193-899e-19bdfda2ce63 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:59.659514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cec72d-44c0-4193-899e-19bdfda2ce63 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:59.659879 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cec72d-44c0-4193-899e-19bdfda2ce63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:59.668357 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c59745-967c-4d0e-ad25-95aed608d49e None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:59.681530 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-30cec72d-44c0-4193-899e-19bdfda2ce63 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:43:59.683008 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-30cec72d-44c0-4193-899e-19bdfda2ce63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:43:59.706879 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5cc22-ef57-410d-9c6f-35a82aa7b7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:59.707689 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5cc22-ef57-410d-9c6f-35a82aa7b7b7 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:59.708099 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5cc22-ef57-410d-9c6f-35a82aa7b7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:59.708375 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5cc22-ef57-410d-9c6f-35a82aa7b7b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:59.720175 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5cc22-ef57-410d-9c6f-35a82aa7b7b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:59.727953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-02c5cc22-ef57-410d-9c6f-35a82aa7b7b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:59.727953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:59.727953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:59.727953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:59.727953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:59.727953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:59.727953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:59.727953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:59.727953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:59.727953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:59.727953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:59.727953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:59.727953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:59.727953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:59.727953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:59.727953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:59.728866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:59.728866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:59.728866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:59.728866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:59.728866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:59.728866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:59.728866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:59.728866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:59.728866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:59.728866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:59.728866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:59.728866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:43:59.728866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:59.728866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:59.728866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:59.728866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:59.729648 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:59.729648 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:59.729648 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:59.729648 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:59.729648 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:59.729648 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:59.729648 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:59.729648 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:59.729648 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:59.729648 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:59.729648 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 08:43:59.729648 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:43:59.730514 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 159/326] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:43:59.737069 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5cc22-ef57-410d-9c6f-35a82aa7b7b7 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:59.761002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 168/327] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:43:59.790182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cec72d-44c0-4193-899e-19bdfda2ce63 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:59.847177 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5cc22-ef57-410d-9c6f-35a82aa7b7b7 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:59.880321 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7d264-9b6b-4599-93d7-4b698b8ed5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:59.880994 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7d264-9b6b-4599-93d7-4b698b8ed5c7 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:59.881277 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7d264-9b6b-4599-93d7-4b698b8ed5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:59.881550 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7d264-9b6b-4599-93d7-4b698b8ed5c7 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:59.882299 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7d264-9b6b-4599-93d7-4b698b8ed5c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:43:59.882610 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7d264-9b6b-4599-93d7-4b698b8ed5c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:43:59.884020 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7d264-9b6b-4599-93d7-4b698b8ed5c7 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:43:59.893506 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 160/328] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:43:59.894875 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cec72d-44c0-4193-899e-19bdfda2ce63 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:43:59.898718 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7d264-9b6b-4599-93d7-4b698b8ed5c7 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:43:59.936942 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df2e94-c74f-488f-8ab5-2ad8d853db39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:43:59.937988 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df2e94-c74f-488f-8ab5-2ad8d853db39 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:43:59.938267 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df2e94-c74f-488f-8ab5-2ad8d853db39 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:43:59.938539 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df2e94-c74f-488f-8ab5-2ad8d853db39 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:43:59.953748 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df2e94-c74f-488f-8ab5-2ad8d853db39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:43:59.961320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-66df2e94-c74f-488f-8ab5-2ad8d853db39 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 02 08:43:59.961320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:43:59.961320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:43:59.961320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:43:59.961320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:43:59.961320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:43:59.961320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:43:59.961320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:43:59.961320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:43:59.961320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:43:59.961320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:43:59.961320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:43:59.961320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:43:59.961320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:43:59.961320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:43:59.961320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:43:59.962661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:43:59.962661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:43:59.962661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:43:59.962661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:43:59.962661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:43:59.962661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:43:59.962661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:43:59.962661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:43:59.962661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:43:59.962661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:43:59.962661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:43:59.962661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:43:59.962661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:43:59.962661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:43:59.962661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:43:59.962661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:43:59.963582 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:43:59.963582 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:43:59.963582 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:43:59.963582 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:43:59.963582 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:43:59.963582 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:43:59.963582 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:43:59.963582 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:43:59.963582 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:43:59.963582 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:43:59.963582 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 02 08:43:59.963582 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:43:59.963582 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 169/329] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:43:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:43:59.969723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df2e94-c74f-488f-8ab5-2ad8d853db39 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:00.021061 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7d264-9b6b-4599-93d7-4b698b8ed5c7 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:00.063860 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15078b91-a803-4f5c-869a-98ea1325582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:00.064748 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15078b91-a803-4f5c-869a-98ea1325582b None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:00.065072 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15078b91-a803-4f5c-869a-98ea1325582b None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:00.065350 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15078b91-a803-4f5c-869a-98ea1325582b None admin] PATH_INFO: `/v3/users/4bc07bd750c542af934d96352708d8df` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:00.066560 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15078b91-a803-4f5c-869a-98ea1325582b None admin] RBAC: Authorizing `identity:get_user(user_id=4bc07bd750c542af934d96352708d8df)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:00.068008 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15078b91-a803-4f5c-869a-98ea1325582b None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:00.070107 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 161/330] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:43:59 2022] GET /identity/v3/users/4bc07bd750c542af934d96352708d8df => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:00.072874 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df2e94-c74f-488f-8ab5-2ad8d853db39 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:00.075493 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15078b91-a803-4f5c-869a-98ea1325582b None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:00.115439 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5dbe0-4142-46ad-a7b1-42e4a370e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:00.116482 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5dbe0-4142-46ad-a7b1-42e4a370e551 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:00.116910 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5dbe0-4142-46ad-a7b1-42e4a370e551 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:00.117426 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5dbe0-4142-46ad-a7b1-42e4a370e551 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:00.118331 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5dbe0-4142-46ad-a7b1-42e4a370e551 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:00.118827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5dbe0-4142-46ad-a7b1-42e4a370e551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:00.120891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5dbe0-4142-46ad-a7b1-42e4a370e551 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:00.132484 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 170/331] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:43:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:00.140749 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5dbe0-4142-46ad-a7b1-42e4a370e551 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:00.202424 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15078b91-a803-4f5c-869a-98ea1325582b None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:00.243028 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff52fa-ebe0-478b-a12b-7a26f9755670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:00.243737 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff52fa-ebe0-478b-a12b-7a26f9755670 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:00.244018 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff52fa-ebe0-478b-a12b-7a26f9755670 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:00.244322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff52fa-ebe0-478b-a12b-7a26f9755670 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:00.245144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff52fa-ebe0-478b-a12b-7a26f9755670 None admin] RBAC: Adding query filter params (role.id=722968fb4ca44c1795d61c44f61a78d9, user.id=4bc07bd750c542af934d96352708d8df, scope.system=all) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:00.245505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff52fa-ebe0-478b-a12b-7a26f9755670 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:00.246945 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff52fa-ebe0-478b-a12b-7a26f9755670 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:00.262223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 162/332] 10.222.0.18 () {56 vars in 1308 bytes} [Mon May 2 08:44:00 2022] GET /identity/v3/role_assignments?user.id=4bc07bd750c542af934d96352708d8df&scope.system=all&role.id=722968fb4ca44c1795d61c44f61a78d9 => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:00.276954 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5dbe0-4142-46ad-a7b1-42e4a370e551 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:00.315074 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f53db-560d-49f6-9eb2-bc6603f93c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:00.316294 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f53db-560d-49f6-9eb2-bc6603f93c90 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:00.316752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f53db-560d-49f6-9eb2-bc6603f93c90 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:00.317214 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f53db-560d-49f6-9eb2-bc6603f93c90 None admin] PATH_INFO: `/v3/users/52a3b607dfdb4b4192a896ac2e59ae3c` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:00.318651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f53db-560d-49f6-9eb2-bc6603f93c90 None admin] RBAC: Authorizing `identity:get_user(user_id=52a3b607dfdb4b4192a896ac2e59ae3c)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:00.321678 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f53db-560d-49f6-9eb2-bc6603f93c90 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:00.323910 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 171/333] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:44:00 2022] GET /identity/v3/users/52a3b607dfdb4b4192a896ac2e59ae3c => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:00.331072 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff52fa-ebe0-478b-a12b-7a26f9755670 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:00.445886 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff52fa-ebe0-478b-a12b-7a26f9755670 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:00.486733 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c9fb4-b77f-4aeb-a150-39c111cc0891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:00.487984 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c9fb4-b77f-4aeb-a150-39c111cc0891 None admin] REQUEST_METHOD: `PUT` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:00.488460 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c9fb4-b77f-4aeb-a150-39c111cc0891 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:00.488910 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c9fb4-b77f-4aeb-a150-39c111cc0891 None admin] PATH_INFO: `/v3/system/users/52a3b607dfdb4b4192a896ac2e59ae3c/roles/b6b9080e8c6540ef9103f82c4cc9dc83` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:00.490635 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c9fb4-b77f-4aeb-a150-39c111cc0891 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=52a3b607dfdb4b4192a896ac2e59ae3c, role_id=b6b9080e8c6540ef9103f82c4cc9dc83)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:00.492220 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c9fb4-b77f-4aeb-a150-39c111cc0891 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:00.554964 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 163/334] 10.222.0.18 () {58 vars in 1334 bytes} [Mon May 2 08:44:00 2022] PUT /identity/v3/system/users/52a3b607dfdb4b4192a896ac2e59ae3c/roles/b6b9080e8c6540ef9103f82c4cc9dc83 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:44:02.582110 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db009fa4-0567-4eec-aeac-3e4ff9d969ac None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:02.582696 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db009fa4-0567-4eec-aeac-3e4ff9d969ac None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:02.582696 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db009fa4-0567-4eec-aeac-3e4ff9d969ac None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:02.584347 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 172/335] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:02.589552 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfbbb8-a4a4-432b-a062-af4633546f18 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:02.590016 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfbbb8-a4a4-432b-a062-af4633546f18 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:02.590106 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfbbb8-a4a4-432b-a062-af4633546f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:02.617061 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-86dfbbb8-a4a4-432b-a062-af4633546f18 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:02.618277 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-86dfbbb8-a4a4-432b-a062-af4633546f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:02.704955 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 164/336] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:02.753768 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db009fa4-0567-4eec-aeac-3e4ff9d969ac None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:02.874941 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db009fa4-0567-4eec-aeac-3e4ff9d969ac None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:02.877305 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9cd1c-747d-47bb-86dd-cda233fcd1d6 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:02.877595 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9cd1c-747d-47bb-86dd-cda233fcd1d6 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:02.877868 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9cd1c-747d-47bb-86dd-cda233fcd1d6 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:02.879515 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 165/337] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:02.884643 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9e13e-600b-4797-a3b6-b510da3863f4 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:02.885156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9e13e-600b-4797-a3b6-b510da3863f4 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:02.885581 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9e13e-600b-4797-a3b6-b510da3863f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:02.917465 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-4fb9e13e-600b-4797-a3b6-b510da3863f4 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:02.919608 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-4fb9e13e-600b-4797-a3b6-b510da3863f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:02.948788 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ad85d-4391-46d5-a80e-ebbada515c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:02.949601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ad85d-4391-46d5-a80e-ebbada515c53 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:02.949890 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ad85d-4391-46d5-a80e-ebbada515c53 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:02.950171 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ad85d-4391-46d5-a80e-ebbada515c53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:02.985021 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ad85d-4391-46d5-a80e-ebbada515c53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:02.992892 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-e48ad85d-4391-46d5-a80e-ebbada515c53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 08:44:02.992892 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:02.992892 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:02.992892 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:02.992892 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:02.992892 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:02.992892 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:02.992892 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:02.992892 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:02.992892 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:02.992892 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:02.992892 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:02.992892 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:02.992892 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:02.992892 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:02.992892 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:02.993993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:02.993993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:02.993993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:02.993993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:02.993993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:02.993993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:02.993993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:02.993993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:02.993993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:02.993993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:02.993993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:02.993993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:02.993993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:02.993993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:02.993993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:02.993993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:02.994829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:02.994829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:02.994829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:02.994829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:02.994829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:02.994829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:02.994829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:02.994829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:02.994829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:02.994829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:02.994829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 08:44:02.994829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:03.001583 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 173/338] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:03.013042 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ad85d-4391-46d5-a80e-ebbada515c53 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:03.017394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 166/339] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:03.044741 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6c182-ab9e-4b4d-aec3-17c513e60c19 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:03.046393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6c182-ab9e-4b4d-aec3-17c513e60c19 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:03.047202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6c182-ab9e-4b4d-aec3-17c513e60c19 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:03.050319 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 167/340] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:44:03.054957 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329444fa-fbc6-4c54-8ad7-8695fb87c2e0 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:03.055464 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329444fa-fbc6-4c54-8ad7-8695fb87c2e0 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:03.056423 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329444fa-fbc6-4c54-8ad7-8695fb87c2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:03.077268 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-329444fa-fbc6-4c54-8ad7-8695fb87c2e0 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:03.079496 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-329444fa-fbc6-4c54-8ad7-8695fb87c2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:03.160296 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 168/341] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:44:03.161839 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329444fa-fbc6-4c54-8ad7-8695fb87c2e0 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:03.234827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ad85d-4391-46d5-a80e-ebbada515c53 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:03.287993 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329444fa-fbc6-4c54-8ad7-8695fb87c2e0 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:03.312968 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c86879-63df-4f7f-bede-3279dd4d1f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:03.313923 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c86879-63df-4f7f-bede-3279dd4d1f91 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:03.314373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c86879-63df-4f7f-bede-3279dd4d1f91 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:03.314796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c86879-63df-4f7f-bede-3279dd4d1f91 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:03.315701 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c86879-63df-4f7f-bede-3279dd4d1f91 None admin] RBAC: Adding query filter params (name=member) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:03.316188 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c86879-63df-4f7f-bede-3279dd4d1f91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:03.317794 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c86879-63df-4f7f-bede-3279dd4d1f91 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:03.336285 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 174/342] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:44:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:03.337692 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c86879-63df-4f7f-bede-3279dd4d1f91 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:03.338618 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497373b-63e3-43e9-aa60-d9f4344a5af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:03.339433 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497373b-63e3-43e9-aa60-d9f4344a5af0 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:03.339922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497373b-63e3-43e9-aa60-d9f4344a5af0 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:03.340445 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497373b-63e3-43e9-aa60-d9f4344a5af0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:03.355710 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497373b-63e3-43e9-aa60-d9f4344a5af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:03.367525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-9497373b-63e3-43e9-aa60-d9f4344a5af0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:44:03.367525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:03.367525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:03.367525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:03.367525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:03.367525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:03.367525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:03.367525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:03.367525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:03.367525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:03.367525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:03.367525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:03.367525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:03.367525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:03.367525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:03.367525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:03.368546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:03.368546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:03.368546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:03.368546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:03.368546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:03.368546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:03.368546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:03.368546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:03.368546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:03.368546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:03.368546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:03.368546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:03.368546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:03.368546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:03.368546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:03.368546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:03.369337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:03.369337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:03.369337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:03.369337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:03.369337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:03.369337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:03.369337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:03.369337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:03.369337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:03.369337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:03.369337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:44:03.369337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:03.374577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 169/343] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:44:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:03.375877 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497373b-63e3-43e9-aa60-d9f4344a5af0 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:03.485329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497373b-63e3-43e9-aa60-d9f4344a5af0 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:03.528759 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250634b-e793-42f7-935e-b2e8d12747c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:03.529697 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250634b-e793-42f7-935e-b2e8d12747c6 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:03.530849 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250634b-e793-42f7-935e-b2e8d12747c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:03.531268 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250634b-e793-42f7-935e-b2e8d12747c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:03.555790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c86879-63df-4f7f-bede-3279dd4d1f91 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:03.621743 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddad9a-e536-49f3-9dbc-4450d20f7079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:03.622552 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddad9a-e536-49f3-9dbc-4450d20f7079 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:03.622834 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddad9a-e536-49f3-9dbc-4450d20f7079 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:03.623106 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddad9a-e536-49f3-9dbc-4450d20f7079 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:03.646144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250634b-e793-42f7-935e-b2e8d12747c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:03.647805 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250634b-e793-42f7-935e-b2e8d12747c6 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:03.648402 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddad9a-e536-49f3-9dbc-4450d20f7079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:03.665630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-e1ddad9a-e536-49f3-9dbc-4450d20f7079 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 08:44:03.665630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:03.665630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:03.665630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:03.665630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:03.665630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:03.665630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:03.665630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:03.665630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:03.665630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:03.665630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:03.665630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:03.665630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:03.665630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:03.665630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:03.665630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:03.666551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:03.666551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:03.666551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:03.666551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:03.666551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:03.666551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:03.666551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:03.666551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:03.666551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:03.666551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:03.666551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:03.666551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:03.666551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:03.666551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:03.666551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:03.666551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:03.667764 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:03.667764 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:03.667764 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:03.667764 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:03.667764 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:03.667764 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:03.667764 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:03.667764 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:03.667764 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:03.667764 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:03.667764 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 08:44:03.667764 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:03.667764 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 175/344] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:03.667764 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddad9a-e536-49f3-9dbc-4450d20f7079 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:03.809965 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 170/345] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:44:03.810741 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250634b-e793-42f7-935e-b2e8d12747c6 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:03.832856 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddad9a-e536-49f3-9dbc-4450d20f7079 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:03.870603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2093310-d016-40e1-a190-bb217f53f7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:03.871540 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2093310-d016-40e1-a190-bb217f53f7b5 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:03.871984 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2093310-d016-40e1-a190-bb217f53f7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:03.872565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2093310-d016-40e1-a190-bb217f53f7b5 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:03.873477 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2093310-d016-40e1-a190-bb217f53f7b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:03.874167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2093310-d016-40e1-a190-bb217f53f7b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:03.875962 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2093310-d016-40e1-a190-bb217f53f7b5 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:03.885615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 176/346] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:03.886654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2093310-d016-40e1-a190-bb217f53f7b5 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:03.928804 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250634b-e793-42f7-935e-b2e8d12747c6 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:03.964217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffb913-26a4-4b4f-8bb3-06624735fd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:03.965173 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffb913-26a4-4b4f-8bb3-06624735fd98 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:03.965602 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffb913-26a4-4b4f-8bb3-06624735fd98 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:03.966031 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffb913-26a4-4b4f-8bb3-06624735fd98 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:03.966938 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffb913-26a4-4b4f-8bb3-06624735fd98 None admin] RBAC: Adding query filter params (name=member) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:03.967986 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffb913-26a4-4b4f-8bb3-06624735fd98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:03.970207 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffb913-26a4-4b4f-8bb3-06624735fd98 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:03.979315 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 171/347] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:44:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:03.980543 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffb913-26a4-4b4f-8bb3-06624735fd98 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:03.997920 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2093310-d016-40e1-a190-bb217f53f7b5 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:04.034257 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e40c14-79ee-417f-bdc9-ab144678b3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:04.035374 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e40c14-79ee-417f-bdc9-ab144678b3a8 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:04.035830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e40c14-79ee-417f-bdc9-ab144678b3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:04.036359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e40c14-79ee-417f-bdc9-ab144678b3a8 None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:04.037785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e40c14-79ee-417f-bdc9-ab144678b3a8 None admin] RBAC: Authorizing `identity:get_project(project_id=5f507bcdfd314874b0a378d7037ed855)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:04.039476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e40c14-79ee-417f-bdc9-ab144678b3a8 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:04.041688 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 177/348] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:44:03 2022] GET /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:04.043014 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b7831-13f3-4b60-a310-9edb9f77ff9f None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:04.043470 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b7831-13f3-4b60-a310-9edb9f77ff9f None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:04.043906 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b7831-13f3-4b60-a310-9edb9f77ff9f None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:04.045358 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 178/349] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:04.046746 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b7831-13f3-4b60-a310-9edb9f77ff9f None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:04.084700 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffb913-26a4-4b4f-8bb3-06624735fd98 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:04.122540 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2296010-6831-4777-b0dd-db2d64e6aa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:04.123474 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2296010-6831-4777-b0dd-db2d64e6aa05 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:04.124470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2296010-6831-4777-b0dd-db2d64e6aa05 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:04.124948 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2296010-6831-4777-b0dd-db2d64e6aa05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:04.160825 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b7831-13f3-4b60-a310-9edb9f77ff9f None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:04.195103 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2296010-6831-4777-b0dd-db2d64e6aa05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:04.197125 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2296010-6831-4777-b0dd-db2d64e6aa05 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:04.197607 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1077cdc-d0fb-447f-9057-98a549d691e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:04.198365 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1077cdc-d0fb-447f-9057-98a549d691e8 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:04.198790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1077cdc-d0fb-447f-9057-98a549d691e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:04.199166 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1077cdc-d0fb-447f-9057-98a549d691e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:04.271391 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1077cdc-d0fb-447f-9057-98a549d691e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:04.273277 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1077cdc-d0fb-447f-9057-98a549d691e8 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:04.302768 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 172/350] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:44:04.304163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2296010-6831-4777-b0dd-db2d64e6aa05 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:04.418958 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 179/351] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:44:04.420248 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2296010-6831-4777-b0dd-db2d64e6aa05 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:04.421429 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935b5a0-3e61-4cfa-83cc-da8cf036a813 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:04.421907 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935b5a0-3e61-4cfa-83cc-da8cf036a813 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:04.422354 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935b5a0-3e61-4cfa-83cc-da8cf036a813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:04.444299 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-1935b5a0-3e61-4cfa-83cc-da8cf036a813 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:04.445592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-1935b5a0-3e61-4cfa-83cc-da8cf036a813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:04.467436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743a732-d38a-4e3a-87c6-cd82fa6c495b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:04.469047 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743a732-d38a-4e3a-87c6-cd82fa6c495b None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:04.469598 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743a732-d38a-4e3a-87c6-cd82fa6c495b None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:04.469874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743a732-d38a-4e3a-87c6-cd82fa6c495b None admin] PATH_INFO: `/v3/groups/df25a59a7e854ed9ad64629f06284bee` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:04.477060 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743a732-d38a-4e3a-87c6-cd82fa6c495b None admin] RBAC: Authorizing `identity:get_group(group_id=df25a59a7e854ed9ad64629f06284bee)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:04.478748 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743a732-d38a-4e3a-87c6-cd82fa6c495b None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:04.481039 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 173/352] 10.222.0.18 () {56 vars in 1180 bytes} [Mon May 2 08:44:04 2022] GET /identity/v3/groups/df25a59a7e854ed9ad64629f06284bee => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:04.482443 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b66e8d-3be6-450a-9830-98ebeab5c6fa None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:04.482725 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b66e8d-3be6-450a-9830-98ebeab5c6fa None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:04.483609 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b66e8d-3be6-450a-9830-98ebeab5c6fa None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:04.490005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 174/353] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:04.490612 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b66e8d-3be6-450a-9830-98ebeab5c6fa None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:04.530629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 180/354] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:04.536911 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935b5a0-3e61-4cfa-83cc-da8cf036a813 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:04.630167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b66e8d-3be6-450a-9830-98ebeab5c6fa None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:04.669552 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935b5a0-3e61-4cfa-83cc-da8cf036a813 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:04.675338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f53dfc-dc27-40f4-9948-ad5a6f6bc9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:04.677770 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f53dfc-dc27-40f4-9948-ad5a6f6bc9e1 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:04.677770 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f53dfc-dc27-40f4-9948-ad5a6f6bc9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:04.677770 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f53dfc-dc27-40f4-9948-ad5a6f6bc9e1 None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:04.678780 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f53dfc-dc27-40f4-9948-ad5a6f6bc9e1 None admin] RBAC: Authorizing `identity:get_project(project_id=5f507bcdfd314874b0a378d7037ed855)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:04.680654 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f53dfc-dc27-40f4-9948-ad5a6f6bc9e1 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:04.682812 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 175/355] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:44:04 2022] GET /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:04.686811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f53dfc-dc27-40f4-9948-ad5a6f6bc9e1 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:04.714674 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b169180-92bb-4f1c-9d3f-97a3f7304000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:04.715532 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b169180-92bb-4f1c-9d3f-97a3f7304000 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:04.715807 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b169180-92bb-4f1c-9d3f-97a3f7304000 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:04.716105 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b169180-92bb-4f1c-9d3f-97a3f7304000 None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:04.717791 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b169180-92bb-4f1c-9d3f-97a3f7304000 None admin] RBAC: Authorizing `identity:get_project(project_id=8308537c26a949d68d16cd15829ed9e1)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:04.719260 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b169180-92bb-4f1c-9d3f-97a3f7304000 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:04.721009 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 181/356] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:44:04 2022] GET /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:04.722153 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3042638-6f10-48d8-b8aa-974b8f9b6e9c None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:04.722436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3042638-6f10-48d8-b8aa-974b8f9b6e9c None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:04.722708 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3042638-6f10-48d8-b8aa-974b8f9b6e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:04.742448 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-b3042638-6f10-48d8-b8aa-974b8f9b6e9c None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:04.744163 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-b3042638-6f10-48d8-b8aa-974b8f9b6e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:04.809441 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f53dfc-dc27-40f4-9948-ad5a6f6bc9e1 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:04.828951 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 182/357] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:04.829641 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3042638-6f10-48d8-b8aa-974b8f9b6e9c None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:04.858744 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa64fd-63c6-4e90-a27e-26f06104c243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:04.859594 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa64fd-63c6-4e90-a27e-26f06104c243 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:04.860232 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa64fd-63c6-4e90-a27e-26f06104c243 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:04.861214 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa64fd-63c6-4e90-a27e-26f06104c243 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:04.861621 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa64fd-63c6-4e90-a27e-26f06104c243 None admin] RBAC: Adding query filter params (group.id=df25a59a7e854ed9ad64629f06284bee, role.id=722968fb4ca44c1795d61c44f61a78d9, scope.project.id=5f507bcdfd314874b0a378d7037ed855) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:04.862103 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa64fd-63c6-4e90-a27e-26f06104c243 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:04.863881 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa64fd-63c6-4e90-a27e-26f06104c243 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:04.871796 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 176/358] 10.222.0.18 () {56 vars in 1376 bytes} [Mon May 2 08:44:04 2022] GET /identity/v3/role_assignments?group.id=df25a59a7e854ed9ad64629f06284bee&scope.project.id=5f507bcdfd314874b0a378d7037ed855&role.id=722968fb4ca44c1795d61c44f61a78d9 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:04.872998 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa64fd-63c6-4e90-a27e-26f06104c243 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:04.966791 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3042638-6f10-48d8-b8aa-974b8f9b6e9c None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:05.005057 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ef46a-8df3-444e-917e-f126dec8dfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:05.005890 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ef46a-8df3-444e-917e-f126dec8dfb1 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:05.006167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ef46a-8df3-444e-917e-f126dec8dfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:05.006624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ef46a-8df3-444e-917e-f126dec8dfb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:05.009507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa64fd-63c6-4e90-a27e-26f06104c243 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:05.018899 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ef46a-8df3-444e-917e-f126dec8dfb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:05.027134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-495ef46a-8df3-444e-917e-f126dec8dfb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:44:05.027134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:05.027134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:05.027134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:05.027134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:05.027134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:05.027134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:05.027134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:05.027134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:05.027134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:05.027134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:05.027134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:05.027134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:05.027134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:05.027134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:05.027134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:05.028167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:05.028167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:05.028167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:05.028167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:05.028167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:05.028167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:05.028167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:05.028167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:05.028167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:05.028167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:05.028167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:05.028167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:05.028167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:05.028167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:05.028167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:05.028167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:05.028966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:05.028966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:05.028966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:05.028966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:05.028966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:05.028966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:05.028966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:05.028966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:05.028966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:05.028966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:05.028966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:44:05.028966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:05.028966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 183/359] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:44:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:05.029621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ef46a-8df3-444e-917e-f126dec8dfb1 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:05.059811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1257ab-1493-4207-b03f-7eb42ea6cac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:05.060824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1257ab-1493-4207-b03f-7eb42ea6cac1 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:05.061215 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1257ab-1493-4207-b03f-7eb42ea6cac1 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:05.061660 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1257ab-1493-4207-b03f-7eb42ea6cac1 None admin] PATH_INFO: `/v3/groups/df25a59a7e854ed9ad64629f06284bee` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:05.063002 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1257ab-1493-4207-b03f-7eb42ea6cac1 None admin] RBAC: Authorizing `identity:get_group(group_id=df25a59a7e854ed9ad64629f06284bee)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:05.064569 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1257ab-1493-4207-b03f-7eb42ea6cac1 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:05.067518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 177/360] 10.222.0.18 () {56 vars in 1180 bytes} [Mon May 2 08:44:04 2022] GET /identity/v3/groups/df25a59a7e854ed9ad64629f06284bee => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:05.068784 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c1b01-c4d0-4dcb-88f8-4264f450b3cc None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:05.069068 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c1b01-c4d0-4dcb-88f8-4264f450b3cc None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:05.069340 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c1b01-c4d0-4dcb-88f8-4264f450b3cc None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:05.073320 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 178/361] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:05.074295 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c1b01-c4d0-4dcb-88f8-4264f450b3cc None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:05.161671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ef46a-8df3-444e-917e-f126dec8dfb1 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:05.204943 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b502871-16c8-42eb-ad86-871bde26e736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:05.206725 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b502871-16c8-42eb-ad86-871bde26e736 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:05.207190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b502871-16c8-42eb-ad86-871bde26e736 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:05.207788 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b502871-16c8-42eb-ad86-871bde26e736 None admin] PATH_INFO: `/v3/groups/df25a59a7e854ed9ad64629f06284bee` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:05.209578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b502871-16c8-42eb-ad86-871bde26e736 None admin] RBAC: Authorizing `identity:get_group(group_id=df25a59a7e854ed9ad64629f06284bee)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:05.211432 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b502871-16c8-42eb-ad86-871bde26e736 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:05.216181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 184/362] 10.222.0.18 () {56 vars in 1180 bytes} [Mon May 2 08:44:05 2022] GET /identity/v3/groups/df25a59a7e854ed9ad64629f06284bee => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:05.216333 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c1b01-c4d0-4dcb-88f8-4264f450b3cc None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:05.216415 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b502871-16c8-42eb-ad86-871bde26e736 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:05.256038 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ec6e-914e-438f-9c9b-0b4821c81d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:05.256892 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ec6e-914e-438f-9c9b-0b4821c81d1b None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:05.257175 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ec6e-914e-438f-9c9b-0b4821c81d1b None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:05.257456 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ec6e-914e-438f-9c9b-0b4821c81d1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:05.274633 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4ec6e-914e-438f-9c9b-0b4821c81d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:05.283738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-6db4ec6e-914e-438f-9c9b-0b4821c81d1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 02 08:44:05.283738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:05.283738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:05.283738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:05.283738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:05.283738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:05.283738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:05.283738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:05.283738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:05.283738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:05.283738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:05.283738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:05.283738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:05.283738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:05.283738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:05.283738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:05.284735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:05.284735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:05.284735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:05.284735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:05.284735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:05.284735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:05.284735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:05.284735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:05.284735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:05.284735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:05.284735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:05.284735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:05.284735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:05.284735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:05.284735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:05.284735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:05.289590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:05.289590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:05.289590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:05.289590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:05.289590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:05.289590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:05.289590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:05.289590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:05.289590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:05.289590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:05.289590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 02 08:44:05.289590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:05.289590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 179/363] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:05.289590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ec6e-914e-438f-9c9b-0b4821c81d1b None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:05.348911 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b502871-16c8-42eb-ad86-871bde26e736 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:05.392035 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b3c2d-e391-41cf-99a6-f25fa21cf340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:05.392744 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b3c2d-e391-41cf-99a6-f25fa21cf340 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:05.393047 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b3c2d-e391-41cf-99a6-f25fa21cf340 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:05.393306 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b3c2d-e391-41cf-99a6-f25fa21cf340 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:05.394061 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b3c2d-e391-41cf-99a6-f25fa21cf340 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:05.394373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b3c2d-e391-41cf-99a6-f25fa21cf340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:05.395749 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b3c2d-e391-41cf-99a6-f25fa21cf340 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:05.404698 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 185/364] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:05.407826 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6104df-c25e-49c9-abd5-9333fe07288e None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:05.409299 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6104df-c25e-49c9-abd5-9333fe07288e None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:05.409875 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6104df-c25e-49c9-abd5-9333fe07288e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:05.419888 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ec6e-914e-438f-9c9b-0b4821c81d1b None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:05.426699 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-9b6104df-c25e-49c9-abd5-9333fe07288e None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:05.427885 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-9b6104df-c25e-49c9-abd5-9333fe07288e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:05.469732 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f9041-682a-425c-8c20-e86855af9ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:05.470404 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f9041-682a-425c-8c20-e86855af9ff0 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:05.470695 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f9041-682a-425c-8c20-e86855af9ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:05.470975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f9041-682a-425c-8c20-e86855af9ff0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:05.471990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f9041-682a-425c-8c20-e86855af9ff0 None admin] RBAC: Adding query filter params (group.id=df25a59a7e854ed9ad64629f06284bee, role.id=b860fb30a96b4b2ea790453a2a4f6044, scope.project.id=5f507bcdfd314874b0a378d7037ed855) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:05.472543 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f9041-682a-425c-8c20-e86855af9ff0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:05.474003 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f9041-682a-425c-8c20-e86855af9ff0 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:05.480939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 180/365] 10.222.0.18 () {56 vars in 1376 bytes} [Mon May 2 08:44:05 2022] GET /identity/v3/role_assignments?group.id=df25a59a7e854ed9ad64629f06284bee&scope.project.id=5f507bcdfd314874b0a378d7037ed855&role.id=b860fb30a96b4b2ea790453a2a4f6044 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:05.481763 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f9041-682a-425c-8c20-e86855af9ff0 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:05.521676 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 186/366] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:05.522483 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6104df-c25e-49c9-abd5-9333fe07288e None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:05.612337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f9041-682a-425c-8c20-e86855af9ff0 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:05.653446 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6104df-c25e-49c9-abd5-9333fe07288e None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:05.661065 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da190e-b63c-4f17-8c8f-420b80de569a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:05.661746 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da190e-b63c-4f17-8c8f-420b80de569a None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:05.662027 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da190e-b63c-4f17-8c8f-420b80de569a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:05.662299 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da190e-b63c-4f17-8c8f-420b80de569a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:05.663236 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da190e-b63c-4f17-8c8f-420b80de569a None admin] RBAC: Adding query filter params (group.id=df25a59a7e854ed9ad64629f06284bee, role.id=722968fb4ca44c1795d61c44f61a78d9, scope.project.id=8308537c26a949d68d16cd15829ed9e1) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:05.663550 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da190e-b63c-4f17-8c8f-420b80de569a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:05.665084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da190e-b63c-4f17-8c8f-420b80de569a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:05.671976 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 181/367] 10.222.0.18 () {56 vars in 1376 bytes} [Mon May 2 08:44:05 2022] GET /identity/v3/role_assignments?group.id=df25a59a7e854ed9ad64629f06284bee&scope.project.id=8308537c26a949d68d16cd15829ed9e1&role.id=722968fb4ca44c1795d61c44f61a78d9 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:05.672863 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da190e-b63c-4f17-8c8f-420b80de569a None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:05.707544 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72d70e-58d1-4b6d-9813-68428cbc0815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:05.708307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72d70e-58d1-4b6d-9813-68428cbc0815 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:05.708595 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72d70e-58d1-4b6d-9813-68428cbc0815 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:05.708878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72d70e-58d1-4b6d-9813-68428cbc0815 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:05.709702 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72d70e-58d1-4b6d-9813-68428cbc0815 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:05.710014 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72d70e-58d1-4b6d-9813-68428cbc0815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:05.711826 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72d70e-58d1-4b6d-9813-68428cbc0815 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:05.724551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 187/368] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:44:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:05.725394 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72d70e-58d1-4b6d-9813-68428cbc0815 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:05.783949 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da190e-b63c-4f17-8c8f-420b80de569a None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:05.822613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010f964-e8e7-4ad0-9451-71423044908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:05.823690 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010f964-e8e7-4ad0-9451-71423044908e None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:05.823975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010f964-e8e7-4ad0-9451-71423044908e None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:05.824287 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010f964-e8e7-4ad0-9451-71423044908e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:05.850548 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72d70e-58d1-4b6d-9813-68428cbc0815 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:05.893863 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83e249-6332-4443-8ffc-10e742b30e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:05.894822 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83e249-6332-4443-8ffc-10e742b30e9e None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:05.895134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83e249-6332-4443-8ffc-10e742b30e9e None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:05.895406 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83e249-6332-4443-8ffc-10e742b30e9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:05.908150 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83e249-6332-4443-8ffc-10e742b30e9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:05.914101 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010f964-e8e7-4ad0-9451-71423044908e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:05.915606 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010f964-e8e7-4ad0-9451-71423044908e None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:05.916346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-7e83e249-6332-4443-8ffc-10e742b30e9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:44:05.916346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:05.916346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:05.916346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:05.916346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:05.916346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:05.916346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:05.916346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:05.916346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:05.916346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:05.916346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:05.916346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:05.916346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:05.916346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:05.916346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:05.916346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:05.918373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:05.918373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:05.918373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:05.918373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:05.918373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:05.918373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:05.918373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:05.918373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:05.918373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:05.918373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:05.918373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:05.918373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:05.918373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:05.918373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:05.918373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:05.918373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:05.920327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:05.920327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:05.920327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:05.920327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:05.920327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:05.920327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:05.920327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:05.920327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:05.920327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:05.920327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:05.920327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:44:05.920327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:05.920327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 188/369] 10.222.0.18 () {56 vars in 1096 bytes} [Mon May 2 08:44:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:05.920327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83e249-6332-4443-8ffc-10e742b30e9e None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:06.028578 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 182/370] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:44:06.029261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010f964-e8e7-4ad0-9451-71423044908e None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:06.032122 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83e249-6332-4443-8ffc-10e742b30e9e None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:06.068641 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c3590-e7fc-4022-aa6f-7fac09c928a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:06.069442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c3590-e7fc-4022-aa6f-7fac09c928a5 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:06.069726 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c3590-e7fc-4022-aa6f-7fac09c928a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:06.070007 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c3590-e7fc-4022-aa6f-7fac09c928a5 None admin] PATH_INFO: `/v3/users/52a3b607dfdb4b4192a896ac2e59ae3c` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:06.071314 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c3590-e7fc-4022-aa6f-7fac09c928a5 None admin] RBAC: Authorizing `identity:get_user(user_id=52a3b607dfdb4b4192a896ac2e59ae3c)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:06.073144 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c3590-e7fc-4022-aa6f-7fac09c928a5 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:06.077364 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 189/371] 10.222.0.18 () {56 vars in 1177 bytes} [Mon May 2 08:44:05 2022] GET /identity/v3/users/52a3b607dfdb4b4192a896ac2e59ae3c => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:06.078278 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c3590-e7fc-4022-aa6f-7fac09c928a5 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:06.131170 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010f964-e8e7-4ad0-9451-71423044908e None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:06.169679 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b47afa-91c0-4aef-a5ea-29a62aa5a399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:06.170552 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b47afa-91c0-4aef-a5ea-29a62aa5a399 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:06.170959 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b47afa-91c0-4aef-a5ea-29a62aa5a399 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:06.171183 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b47afa-91c0-4aef-a5ea-29a62aa5a399 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:06.171864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b47afa-91c0-4aef-a5ea-29a62aa5a399 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:06.172204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b47afa-91c0-4aef-a5ea-29a62aa5a399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:06.173630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b47afa-91c0-4aef-a5ea-29a62aa5a399 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:06.187320 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 183/372] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:06.188202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b47afa-91c0-4aef-a5ea-29a62aa5a399 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:06.188380 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c3590-e7fc-4022-aa6f-7fac09c928a5 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:06.224806 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a307f-b080-4981-80bf-8c57a4857219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:06.225670 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a307f-b080-4981-80bf-8c57a4857219 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:06.225950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a307f-b080-4981-80bf-8c57a4857219 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:06.226228 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a307f-b080-4981-80bf-8c57a4857219 None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:06.227537 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a307f-b080-4981-80bf-8c57a4857219 None admin] RBAC: Authorizing `identity:get_project(project_id=8308537c26a949d68d16cd15829ed9e1)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:06.229063 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a307f-b080-4981-80bf-8c57a4857219 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:06.230852 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 190/373] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:44:06 2022] GET /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:06.233082 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a307f-b080-4981-80bf-8c57a4857219 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:06.350329 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a307f-b080-4981-80bf-8c57a4857219 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:06.390704 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41eacf-63bf-4590-a13b-940708355d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:06.391365 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41eacf-63bf-4590-a13b-940708355d5d None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:06.391650 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41eacf-63bf-4590-a13b-940708355d5d None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:06.391929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41eacf-63bf-4590-a13b-940708355d5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:06.398134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b47afa-91c0-4aef-a5ea-29a62aa5a399 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:06.470012 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41eacf-63bf-4590-a13b-940708355d5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:06.471596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41eacf-63bf-4590-a13b-940708355d5d None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:06.472225 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cfac2-1377-453c-a4ca-5a070f20d847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:06.473102 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cfac2-1377-453c-a4ca-5a070f20d847 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:06.473579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cfac2-1377-453c-a4ca-5a070f20d847 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:06.474047 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cfac2-1377-453c-a4ca-5a070f20d847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:06.475077 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cfac2-1377-453c-a4ca-5a070f20d847 None admin] RBAC: Adding query filter params (role.id=b6b9080e8c6540ef9103f82c4cc9dc83, user.id=52a3b607dfdb4b4192a896ac2e59ae3c, scope.system=all) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:06.475586 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cfac2-1377-453c-a4ca-5a070f20d847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:06.477422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cfac2-1377-453c-a4ca-5a070f20d847 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:06.502207 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 184/374] 10.222.0.18 () {56 vars in 1308 bytes} [Mon May 2 08:44:06 2022] GET /identity/v3/role_assignments?user.id=52a3b607dfdb4b4192a896ac2e59ae3c&scope.system=all&role.id=b6b9080e8c6540ef9103f82c4cc9dc83 => generated 510 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:06.503341 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cfac2-1377-453c-a4ca-5a070f20d847 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:06.602403 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 191/375] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:44:06.612412 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41eacf-63bf-4590-a13b-940708355d5d None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:06.685546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cfac2-1377-453c-a4ca-5a070f20d847 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:06.725314 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ceb0c0-6384-48ed-90f3-6e810036b5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:06.726211 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ceb0c0-6384-48ed-90f3-6e810036b5e1 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:06.726473 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ceb0c0-6384-48ed-90f3-6e810036b5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:06.726744 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ceb0c0-6384-48ed-90f3-6e810036b5e1 None admin] PATH_INFO: `/v3/groups/df25a59a7e854ed9ad64629f06284bee` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:06.728972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ceb0c0-6384-48ed-90f3-6e810036b5e1 None admin] RBAC: Authorizing `identity:get_group(group_id=df25a59a7e854ed9ad64629f06284bee)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:06.730451 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ceb0c0-6384-48ed-90f3-6e810036b5e1 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:06.732162 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 185/376] 10.222.0.18 () {56 vars in 1180 bytes} [Mon May 2 08:44:06 2022] GET /identity/v3/groups/df25a59a7e854ed9ad64629f06284bee => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:06.738598 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ceb0c0-6384-48ed-90f3-6e810036b5e1 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:06.788419 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41eacf-63bf-4590-a13b-940708355d5d None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:06.824822 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eabab-65b6-40a0-a5d7-0c72a4af4458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:06.825683 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eabab-65b6-40a0-a5d7-0c72a4af4458 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:06.825965 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eabab-65b6-40a0-a5d7-0c72a4af4458 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:06.826237 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eabab-65b6-40a0-a5d7-0c72a4af4458 None admin] PATH_INFO: `/v3/projects/551938bc45944ca2b1d6b90c735fdb29` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:06.828523 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366eabab-65b6-40a0-a5d7-0c72a4af4458 None admin] RBAC: Authorizing `identity:get_project(project_id=551938bc45944ca2b1d6b90c735fdb29)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:06.829985 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366eabab-65b6-40a0-a5d7-0c72a4af4458 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:06.832154 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 192/377] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:44:06 2022] GET /identity/v3/projects/551938bc45944ca2b1d6b90c735fdb29 => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:06.837394 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eabab-65b6-40a0-a5d7-0c72a4af4458 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:06.864508 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ceb0c0-6384-48ed-90f3-6e810036b5e1 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:06.899273 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a4cf2-5f41-4e02-9bfd-c8d6cb24c71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:06.899939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a4cf2-5f41-4e02-9bfd-c8d6cb24c71e None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:06.901222 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a4cf2-5f41-4e02-9bfd-c8d6cb24c71e None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:06.901504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a4cf2-5f41-4e02-9bfd-c8d6cb24c71e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:06.902335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a4cf2-5f41-4e02-9bfd-c8d6cb24c71e None admin] RBAC: Adding query filter params (group.id=df25a59a7e854ed9ad64629f06284bee, role.id=b860fb30a96b4b2ea790453a2a4f6044, scope.project.id=8308537c26a949d68d16cd15829ed9e1) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:06.902646 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a4cf2-5f41-4e02-9bfd-c8d6cb24c71e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:06.904112 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a4cf2-5f41-4e02-9bfd-c8d6cb24c71e None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:06.912237 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 186/378] 10.222.0.18 () {56 vars in 1376 bytes} [Mon May 2 08:44:06 2022] GET /identity/v3/role_assignments?group.id=df25a59a7e854ed9ad64629f06284bee&scope.project.id=8308537c26a949d68d16cd15829ed9e1&role.id=b860fb30a96b4b2ea790453a2a4f6044 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:06.953070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eabab-65b6-40a0-a5d7-0c72a4af4458 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:06.990971 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb358dfb-de3e-434a-ba20-8499ea0538ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:06.991851 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb358dfb-de3e-434a-ba20-8499ea0538ce None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:06.992165 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb358dfb-de3e-434a-ba20-8499ea0538ce None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:06.992485 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb358dfb-de3e-434a-ba20-8499ea0538ce None admin] PATH_INFO: `/v3/groups/ac61443c4a3c4acd9492d162e53ff481` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:07.001537 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb358dfb-de3e-434a-ba20-8499ea0538ce None admin] RBAC: Authorizing `identity:get_group(group_id=ac61443c4a3c4acd9492d162e53ff481)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:07.003025 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb358dfb-de3e-434a-ba20-8499ea0538ce None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:07.005180 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 193/379] 10.222.0.18 () {56 vars in 1180 bytes} [Mon May 2 08:44:06 2022] GET /identity/v3/groups/ac61443c4a3c4acd9492d162e53ff481 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:07.010934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a4cf2-5f41-4e02-9bfd-c8d6cb24c71e None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:07.139009 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a4cf2-5f41-4e02-9bfd-c8d6cb24c71e None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:07.180872 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15b34a-4fbb-48e2-983d-eb551c259d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:07.181537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15b34a-4fbb-48e2-983d-eb551c259d63 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:07.181821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15b34a-4fbb-48e2-983d-eb551c259d63 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:07.182098 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15b34a-4fbb-48e2-983d-eb551c259d63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:07.182924 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15b34a-4fbb-48e2-983d-eb551c259d63 None admin] RBAC: Adding query filter params (group.id=ac61443c4a3c4acd9492d162e53ff481, role.id=509216a314244b96b05d3fe56b0d9cd1, scope.project.id=551938bc45944ca2b1d6b90c735fdb29) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:07.183236 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15b34a-4fbb-48e2-983d-eb551c259d63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:07.184732 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15b34a-4fbb-48e2-983d-eb551c259d63 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:07.192815 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 187/380] 10.222.0.18 () {56 vars in 1376 bytes} [Mon May 2 08:44:07 2022] GET /identity/v3/role_assignments?group.id=ac61443c4a3c4acd9492d162e53ff481&scope.project.id=551938bc45944ca2b1d6b90c735fdb29&role.id=509216a314244b96b05d3fe56b0d9cd1 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:07.749476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e83ce-44ed-4811-a8a4-54fd416def14 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:07.749815 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e83ce-44ed-4811-a8a4-54fd416def14 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:07.750055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e83ce-44ed-4811-a8a4-54fd416def14 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:07.751733 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 194/381] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:07.756694 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece87ec-6ba7-4215-ae3c-3bf85fa8a222 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:07.757283 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece87ec-6ba7-4215-ae3c-3bf85fa8a222 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:07.757761 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece87ec-6ba7-4215-ae3c-3bf85fa8a222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:07.777215 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-dece87ec-6ba7-4215-ae3c-3bf85fa8a222 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:07.778691 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-dece87ec-6ba7-4215-ae3c-3bf85fa8a222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:07.868101 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 188/382] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:07.908316 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e83ce-44ed-4811-a8a4-54fd416def14 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:08.044818 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e83ce-44ed-4811-a8a4-54fd416def14 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:08.084186 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d9c15-154e-4b0b-a966-e5ed20d5164e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:08.084990 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d9c15-154e-4b0b-a966-e5ed20d5164e None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:08.085268 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d9c15-154e-4b0b-a966-e5ed20d5164e None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:08.085539 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d9c15-154e-4b0b-a966-e5ed20d5164e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:08.096203 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d9c15-154e-4b0b-a966-e5ed20d5164e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:08.104023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-da8d9c15-154e-4b0b-a966-e5ed20d5164e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 08:44:08.104023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:08.104023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:08.104023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:08.104023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:08.104023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:08.104023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:08.104023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:08.104023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:08.104023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:08.104023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:08.104023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:08.104023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:08.104023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:08.104023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:08.104023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:08.110459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:08.110459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:08.110459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:08.110459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:08.110459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:08.110459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:08.110459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:08.110459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:08.110459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:08.110459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:08.110459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:08.110459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:08.110459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:08.110459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:08.110459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:08.110459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:08.111628 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:08.111628 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:08.111628 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:08.111628 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:08.111628 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:08.111628 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:08.111628 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:08.111628 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:08.111628 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:08.111628 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:08.111628 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 08:44:08.111628 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:08.111628 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 195/383] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:08.113694 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece87ec-6ba7-4215-ae3c-3bf85fa8a222 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:08.254822 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece87ec-6ba7-4215-ae3c-3bf85fa8a222 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:08.296867 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078e94a-5b0c-49e8-8906-12aaee9ab1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:08.297463 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078e94a-5b0c-49e8-8906-12aaee9ab1b0 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:08.297746 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078e94a-5b0c-49e8-8906-12aaee9ab1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:08.298018 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078e94a-5b0c-49e8-8906-12aaee9ab1b0 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:08.298770 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078e94a-5b0c-49e8-8906-12aaee9ab1b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:08.299078 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078e94a-5b0c-49e8-8906-12aaee9ab1b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:08.300485 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078e94a-5b0c-49e8-8906-12aaee9ab1b0 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:08.309122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 189/384] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:44:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:08.316171 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d9c15-154e-4b0b-a966-e5ed20d5164e None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:08.442215 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d9c15-154e-4b0b-a966-e5ed20d5164e None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:08.486156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0e43e-01d0-4f5f-a7fd-9dd480c7bbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:08.487028 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0e43e-01d0-4f5f-a7fd-9dd480c7bbdf None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:08.487310 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0e43e-01d0-4f5f-a7fd-9dd480c7bbdf None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:08.487599 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0e43e-01d0-4f5f-a7fd-9dd480c7bbdf None admin] PATH_INFO: `/v3/groups/df25a59a7e854ed9ad64629f06284bee` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:08.488822 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0e43e-01d0-4f5f-a7fd-9dd480c7bbdf None admin] RBAC: Authorizing `identity:get_group(group_id=df25a59a7e854ed9ad64629f06284bee)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:08.490598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0e43e-01d0-4f5f-a7fd-9dd480c7bbdf None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:08.492580 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 196/385] 10.222.0.18 () {56 vars in 1180 bytes} [Mon May 2 08:44:08 2022] GET /identity/v3/groups/df25a59a7e854ed9ad64629f06284bee => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:08.497890 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078e94a-5b0c-49e8-8906-12aaee9ab1b0 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:08.607209 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078e94a-5b0c-49e8-8906-12aaee9ab1b0 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:08.647530 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ba7da-2cd5-40e6-abdc-375bad00af2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:08.648439 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ba7da-2cd5-40e6-abdc-375bad00af2a None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:08.648773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ba7da-2cd5-40e6-abdc-375bad00af2a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:08.649050 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ba7da-2cd5-40e6-abdc-375bad00af2a None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:08.650265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ba7da-2cd5-40e6-abdc-375bad00af2a None admin] RBAC: Authorizing `identity:get_project(project_id=5f507bcdfd314874b0a378d7037ed855)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:08.651730 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ba7da-2cd5-40e6-abdc-375bad00af2a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:08.653788 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 190/386] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:44:08 2022] GET /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:08.659926 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0e43e-01d0-4f5f-a7fd-9dd480c7bbdf None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:08.781165 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0e43e-01d0-4f5f-a7fd-9dd480c7bbdf None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:08.825913 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609bebfb-443e-42bc-88c0-b811709f87e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:08.826917 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bebfb-443e-42bc-88c0-b811709f87e4 None admin] REQUEST_METHOD: `PUT` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:08.827138 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bebfb-443e-42bc-88c0-b811709f87e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:08.827413 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bebfb-443e-42bc-88c0-b811709f87e4 None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855/groups/df25a59a7e854ed9ad64629f06284bee/roles/722968fb4ca44c1795d61c44f61a78d9` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:08.833747 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609bebfb-443e-42bc-88c0-b811709f87e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f507bcdfd314874b0a378d7037ed855, group_id=df25a59a7e854ed9ad64629f06284bee, role_id=722968fb4ca44c1795d61c44f61a78d9)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:08.835257 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609bebfb-443e-42bc-88c0-b811709f87e4 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:08.931479 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 197/387] 10.222.0.18 () {58 vars in 1442 bytes} [Mon May 2 08:44:08 2022] PUT /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855/groups/df25a59a7e854ed9ad64629f06284bee/roles/722968fb4ca44c1795d61c44f61a78d9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:44:09.044064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92421e-18c8-4291-a2ae-ded4df6d2cc3 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:09.044603 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92421e-18c8-4291-a2ae-ded4df6d2cc3 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:09.044681 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92421e-18c8-4291-a2ae-ded4df6d2cc3 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:09.047034 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 191/388] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:09.052887 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa57fa8-966a-4f90-88bb-f090208c893c None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:09.053177 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa57fa8-966a-4f90-88bb-f090208c893c None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:09.053461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa57fa8-966a-4f90-88bb-f090208c893c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:09.079212 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-4fa57fa8-966a-4f90-88bb-f090208c893c None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:09.080452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-4fa57fa8-966a-4f90-88bb-f090208c893c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:09.153512 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897d404-fac0-4a1c-9ccf-1320bf6db7bb None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:09.153836 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897d404-fac0-4a1c-9ccf-1320bf6db7bb None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:09.154064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897d404-fac0-4a1c-9ccf-1320bf6db7bb None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:09.156222 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 192/389] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:09.161995 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d15bc-9fb2-46cf-9bf8-82412a7a13a8 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:09.162283 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d15bc-9fb2-46cf-9bf8-82412a7a13a8 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:09.162549 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d15bc-9fb2-46cf-9bf8-82412a7a13a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:09.169550 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 198/390] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:44:09.190599 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-505d15bc-9fb2-46cf-9bf8-82412a7a13a8 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:09.191741 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-505d15bc-9fb2-46cf-9bf8-82412a7a13a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:09.225539 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa57fa8-966a-4f90-88bb-f090208c893c None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:09.282440 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 193/391] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:44:09.306660 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d15bc-9fb2-46cf-9bf8-82412a7a13a8 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:09.356891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa57fa8-966a-4f90-88bb-f090208c893c None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:09.417074 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e73be-da8a-4dc9-9100-b664987f95a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:09.417074 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e73be-da8a-4dc9-9100-b664987f95a3 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:09.417074 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e73be-da8a-4dc9-9100-b664987f95a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:09.417074 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e73be-da8a-4dc9-9100-b664987f95a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:09.428996 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d15bc-9fb2-46cf-9bf8-82412a7a13a8 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:09.443879 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e73be-da8a-4dc9-9100-b664987f95a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:09.457508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-194e73be-da8a-4dc9-9100-b664987f95a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 08:44:09.457508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:09.457508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:09.457508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:09.457508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:09.457508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:09.457508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:09.457508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:09.457508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:09.457508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:09.457508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:09.457508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:09.457508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:09.457508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:09.457508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:09.457508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:09.463130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:09.463130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:09.463130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:09.463130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:09.463130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:09.463130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:09.463130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:09.463130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:09.463130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:09.463130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:09.463130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:09.463130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:09.463130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:09.463130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:09.463130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:09.463130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:09.463934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:09.463934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:09.463934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:09.463934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:09.463934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:09.463934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:09.463934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:09.463934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:09.463934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:09.463934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:09.463934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 08:44:09.463934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:09.463934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 199/392] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:09.472271 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e73be-da8a-4dc9-9100-b664987f95a3 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:09.481251 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b14ef-de27-4021-b340-47eccc547112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:09.482170 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b14ef-de27-4021-b340-47eccc547112 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:09.482452 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b14ef-de27-4021-b340-47eccc547112 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:09.483299 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b14ef-de27-4021-b340-47eccc547112 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:09.505834 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b14ef-de27-4021-b340-47eccc547112 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:09.518127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-246b14ef-de27-4021-b340-47eccc547112 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:44:09.518127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:09.518127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:09.518127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:09.518127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:09.518127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:09.518127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:09.518127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:09.518127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:09.518127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:09.518127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:09.518127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:09.518127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:09.518127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:09.518127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:09.518127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:09.532005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:09.532005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:09.532005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:09.532005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:09.532005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:09.532005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:09.532005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:09.532005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:09.532005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:09.532005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:09.532005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:09.532005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:09.532005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:09.532005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:09.532005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:09.532005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:09.532928 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:09.532928 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:09.532928 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:09.532928 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:09.532928 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:09.532928 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:09.532928 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:09.532928 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:09.532928 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:09.532928 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:09.532928 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:44:09.532928 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:09.532928 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 194/393] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:44:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:09.532928 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b14ef-de27-4021-b340-47eccc547112 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:09.653774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e73be-da8a-4dc9-9100-b664987f95a3 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:09.697420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7e154-8616-4626-94e3-2da9be213e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:09.697998 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7e154-8616-4626-94e3-2da9be213e87 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:09.698282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7e154-8616-4626-94e3-2da9be213e87 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:09.698556 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7e154-8616-4626-94e3-2da9be213e87 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:09.699327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7e154-8616-4626-94e3-2da9be213e87 None admin] RBAC: Adding query filter params (name=member) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:09.699644 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7e154-8616-4626-94e3-2da9be213e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:09.701126 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7e154-8616-4626-94e3-2da9be213e87 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:09.711344 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 200/394] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:44:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:09.716824 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7e154-8616-4626-94e3-2da9be213e87 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:09.721819 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b14ef-de27-4021-b340-47eccc547112 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:09.769670 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bad6f-1fa9-40bf-9338-dc4dcc43f762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:09.770709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bad6f-1fa9-40bf-9338-dc4dcc43f762 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:09.771215 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bad6f-1fa9-40bf-9338-dc4dcc43f762 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:09.771710 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bad6f-1fa9-40bf-9338-dc4dcc43f762 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:09.772695 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20bad6f-1fa9-40bf-9338-dc4dcc43f762 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:09.773208 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20bad6f-1fa9-40bf-9338-dc4dcc43f762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:09.774809 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20bad6f-1fa9-40bf-9338-dc4dcc43f762 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:09.792223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 195/395] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:09.798363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bad6f-1fa9-40bf-9338-dc4dcc43f762 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:09.820040 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7e154-8616-4626-94e3-2da9be213e87 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:09.856088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbebf4-1cd2-4878-b76d-f125c19acbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:09.856088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbebf4-1cd2-4878-b76d-f125c19acbd2 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:09.856088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbebf4-1cd2-4878-b76d-f125c19acbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:09.856088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbebf4-1cd2-4878-b76d-f125c19acbd2 None admin] PATH_INFO: `/v3/groups/df25a59a7e854ed9ad64629f06284bee` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:09.856494 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbebf4-1cd2-4878-b76d-f125c19acbd2 None admin] RBAC: Authorizing `identity:get_group(group_id=df25a59a7e854ed9ad64629f06284bee)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:09.858439 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbebf4-1cd2-4878-b76d-f125c19acbd2 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:09.864065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 201/396] 10.222.0.18 () {56 vars in 1180 bytes} [Mon May 2 08:44:09 2022] GET /identity/v3/groups/df25a59a7e854ed9ad64629f06284bee => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:09.866461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbebf4-1cd2-4878-b76d-f125c19acbd2 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:09.974357 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bad6f-1fa9-40bf-9338-dc4dcc43f762 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:09.981261 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbebf4-1cd2-4878-b76d-f125c19acbd2 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:10.014501 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1d7de-43f9-450d-984e-589ddd769a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:10.015645 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1d7de-43f9-450d-984e-589ddd769a98 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:10.015918 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1d7de-43f9-450d-984e-589ddd769a98 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:10.016229 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1d7de-43f9-450d-984e-589ddd769a98 None admin] PATH_INFO: `/v3/groups/df25a59a7e854ed9ad64629f06284bee` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:10.017573 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1d7de-43f9-450d-984e-589ddd769a98 None admin] RBAC: Authorizing `identity:get_group(group_id=df25a59a7e854ed9ad64629f06284bee)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:10.019619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1d7de-43f9-450d-984e-589ddd769a98 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:10.021609 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 196/397] 10.222.0.18 () {56 vars in 1180 bytes} [Mon May 2 08:44:09 2022] GET /identity/v3/groups/df25a59a7e854ed9ad64629f06284bee => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:10.022910 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4cb84-f658-42f1-9e0e-e724b5b90345 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:10.023198 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4cb84-f658-42f1-9e0e-e724b5b90345 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:10.023475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4cb84-f658-42f1-9e0e-e724b5b90345 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:10.023775 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e49ddd-838d-415f-8f24-ae405cc9ae91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:10.024704 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 197/398] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:10.025051 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e49ddd-838d-415f-8f24-ae405cc9ae91 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:10.025516 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e49ddd-838d-415f-8f24-ae405cc9ae91 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:10.026229 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e49ddd-838d-415f-8f24-ae405cc9ae91 None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:10.027735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e49ddd-838d-415f-8f24-ae405cc9ae91 None admin] RBAC: Authorizing `identity:get_project(project_id=8308537c26a949d68d16cd15829ed9e1)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:10.029416 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4cb84-f658-42f1-9e0e-e724b5b90345 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:10.029747 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e49ddd-838d-415f-8f24-ae405cc9ae91 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:10.031824 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 202/399] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:44:09 2022] GET /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:10.038420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897473c-6f9c-4f03-8356-1d3e3303cc2e None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:10.038420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897473c-6f9c-4f03-8356-1d3e3303cc2e None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:10.038420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897473c-6f9c-4f03-8356-1d3e3303cc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:10.055844 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-a897473c-6f9c-4f03-8356-1d3e3303cc2e None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:10.057372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-a897473c-6f9c-4f03-8356-1d3e3303cc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:10.127729 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 203/400] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:10.129143 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897473c-6f9c-4f03-8356-1d3e3303cc2e None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:10.175533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4cb84-f658-42f1-9e0e-e724b5b90345 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:10.233690 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659d2c2-551e-4499-907a-8a5afbe6b14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:10.234991 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659d2c2-551e-4499-907a-8a5afbe6b14d None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:10.235470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659d2c2-551e-4499-907a-8a5afbe6b14d None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:10.235939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659d2c2-551e-4499-907a-8a5afbe6b14d None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:10.238682 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659d2c2-551e-4499-907a-8a5afbe6b14d None admin] RBAC: Authorizing `identity:get_project(project_id=5f507bcdfd314874b0a378d7037ed855)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:10.241332 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659d2c2-551e-4499-907a-8a5afbe6b14d None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:10.245479 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 198/401] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:44:10 2022] GET /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:10.247262 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659d2c2-551e-4499-907a-8a5afbe6b14d None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:10.296475 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897473c-6f9c-4f03-8356-1d3e3303cc2e None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:10.360804 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e91f1-f102-4d0f-ad47-60dd75ff7ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:10.361969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e91f1-f102-4d0f-ad47-60dd75ff7ef9 None admin] REQUEST_METHOD: `PUT` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:10.362258 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e91f1-f102-4d0f-ad47-60dd75ff7ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:10.362569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e91f1-f102-4d0f-ad47-60dd75ff7ef9 None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1/groups/df25a59a7e854ed9ad64629f06284bee/roles/722968fb4ca44c1795d61c44f61a78d9` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:10.364761 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e91f1-f102-4d0f-ad47-60dd75ff7ef9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8308537c26a949d68d16cd15829ed9e1, group_id=df25a59a7e854ed9ad64629f06284bee, role_id=722968fb4ca44c1795d61c44f61a78d9)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:10.366746 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e91f1-f102-4d0f-ad47-60dd75ff7ef9 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:10.398653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659d2c2-551e-4499-907a-8a5afbe6b14d None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:10.434213 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5334d-47cc-4156-90ab-95959040f862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:10.435113 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5334d-47cc-4156-90ab-95959040f862 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:10.435390 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5334d-47cc-4156-90ab-95959040f862 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:10.435654 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5334d-47cc-4156-90ab-95959040f862 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:10.446475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5334d-47cc-4156-90ab-95959040f862 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:10.455213 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 204/402] 10.222.0.18 () {58 vars in 1442 bytes} [Mon May 2 08:44:10 2022] PUT /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1/groups/df25a59a7e854ed9ad64629f06284bee/roles/722968fb4ca44c1795d61c44f61a78d9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:44:10.456503 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e91f1-f102-4d0f-ad47-60dd75ff7ef9 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:10.464391 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-efe5334d-47cc-4156-90ab-95959040f862 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:44:10.464391 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:10.464391 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:10.464391 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:10.464391 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:10.464391 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:10.464391 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:10.464391 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:10.464391 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:10.464391 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:10.464391 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:10.464391 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:10.464391 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:10.464391 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:10.464391 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:10.464391 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:10.465383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:10.465383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:10.465383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:10.465383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:10.465383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:10.465383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:10.465383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:10.465383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:10.465383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:10.465383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:10.465383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:10.465383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:10.465383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:10.465383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:10.465383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:10.465383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:10.466275 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:10.466275 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:10.466275 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:10.466275 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:10.466275 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:10.466275 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:10.466275 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:10.466275 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:10.466275 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:10.466275 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:10.466275 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:44:10.466275 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:10.466275 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 199/403] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:44:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:10.482237 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5334d-47cc-4156-90ab-95959040f862 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:10.603355 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5334d-47cc-4156-90ab-95959040f862 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:10.616296 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e91f1-f102-4d0f-ad47-60dd75ff7ef9 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:10.644731 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fe204-20c5-408a-bfbd-dd83c84a88d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:10.645423 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fe204-20c5-408a-bfbd-dd83c84a88d2 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:10.645707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fe204-20c5-408a-bfbd-dd83c84a88d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:10.645982 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fe204-20c5-408a-bfbd-dd83c84a88d2 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:10.646873 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fe204-20c5-408a-bfbd-dd83c84a88d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:10.647184 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fe204-20c5-408a-bfbd-dd83c84a88d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:10.648618 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fe204-20c5-408a-bfbd-dd83c84a88d2 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:10.657971 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3766586-3b6d-4911-b8a0-e4558ea54ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:10.661878 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 200/404] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:10.661878 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11cb2a-d135-4238-ac60-fa0fec75b0e5 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:10.661878 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11cb2a-d135-4238-ac60-fa0fec75b0e5 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:10.661878 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11cb2a-d135-4238-ac60-fa0fec75b0e5 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:10.661878 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 201/405] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:10.662731 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3766586-3b6d-4911-b8a0-e4558ea54ccb None admin] REQUEST_METHOD: `PUT` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:10.662731 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3766586-3b6d-4911-b8a0-e4558ea54ccb None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:10.662731 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3766586-3b6d-4911-b8a0-e4558ea54ccb None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855/groups/df25a59a7e854ed9ad64629f06284bee/roles/b860fb30a96b4b2ea790453a2a4f6044` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:10.665352 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11cb2a-d135-4238-ac60-fa0fec75b0e5 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:10.669101 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3766586-3b6d-4911-b8a0-e4558ea54ccb None admin] RBAC: Authorizing `identity:create_grant(project_id=5f507bcdfd314874b0a378d7037ed855, group_id=df25a59a7e854ed9ad64629f06284bee, role_id=b860fb30a96b4b2ea790453a2a4f6044)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:10.671457 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3766586-3b6d-4911-b8a0-e4558ea54ccb None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:10.778010 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11cb2a-d135-4238-ac60-fa0fec75b0e5 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:10.789145 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 205/406] 10.222.0.18 () {58 vars in 1442 bytes} [Mon May 2 08:44:10 2022] PUT /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855/groups/df25a59a7e854ed9ad64629f06284bee/roles/b860fb30a96b4b2ea790453a2a4f6044 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:44:10.790866 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5d174-60bd-4e67-8ee2-d3c2ca34308a None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:10.790993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5d174-60bd-4e67-8ee2-d3c2ca34308a None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:10.791445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5d174-60bd-4e67-8ee2-d3c2ca34308a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:10.822442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-31f5d174-60bd-4e67-8ee2-d3c2ca34308a None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:10.823904 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924c926-9862-43ab-825c-33cd40ebc302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:10.825133 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924c926-9862-43ab-825c-33cd40ebc302 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:10.825571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924c926-9862-43ab-825c-33cd40ebc302 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:10.825989 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924c926-9862-43ab-825c-33cd40ebc302 None admin] PATH_INFO: `/v3/groups/df25a59a7e854ed9ad64629f06284bee` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:10.828153 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924c926-9862-43ab-825c-33cd40ebc302 None admin] RBAC: Authorizing `identity:get_group(group_id=df25a59a7e854ed9ad64629f06284bee)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:10.830351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924c926-9862-43ab-825c-33cd40ebc302 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:10.832093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-31f5d174-60bd-4e67-8ee2-d3c2ca34308a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:10.834432 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 202/407] 10.222.0.18 () {56 vars in 1180 bytes} [Mon May 2 08:44:10 2022] GET /identity/v3/groups/df25a59a7e854ed9ad64629f06284bee => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:10.843070 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924c926-9862-43ab-825c-33cd40ebc302 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:10.968889 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 206/408] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:10.994465 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5d174-60bd-4e67-8ee2-d3c2ca34308a None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:11.026030 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924c926-9862-43ab-825c-33cd40ebc302 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:11.066173 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b22dca-7959-4acc-b9c5-8258fe60546c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:11.067041 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b22dca-7959-4acc-b9c5-8258fe60546c None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:11.067318 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b22dca-7959-4acc-b9c5-8258fe60546c None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:11.067591 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b22dca-7959-4acc-b9c5-8258fe60546c None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:11.072274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b22dca-7959-4acc-b9c5-8258fe60546c None admin] RBAC: Authorizing `identity:get_project(project_id=8308537c26a949d68d16cd15829ed9e1)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:11.073732 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b22dca-7959-4acc-b9c5-8258fe60546c None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:11.075756 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 203/409] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:44:10 2022] GET /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:11.082016 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b22dca-7959-4acc-b9c5-8258fe60546c None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:11.095510 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5d174-60bd-4e67-8ee2-d3c2ca34308a None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:11.131756 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2a9f5-0b8f-46e1-9e21-0a898da3b7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:11.132621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2a9f5-0b8f-46e1-9e21-0a898da3b7c8 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:11.132906 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2a9f5-0b8f-46e1-9e21-0a898da3b7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:11.133228 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2a9f5-0b8f-46e1-9e21-0a898da3b7c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:11.144462 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2a9f5-0b8f-46e1-9e21-0a898da3b7c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:11.153810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-f5b2a9f5-0b8f-46e1-9e21-0a898da3b7c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:44:11.153810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:11.153810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:11.153810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:11.153810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:11.153810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:11.153810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:11.153810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:11.153810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:11.153810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:11.153810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:11.153810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:11.153810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:11.153810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:11.153810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:11.153810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:11.158603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:11.158603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:11.158603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:11.158603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:11.158603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:11.158603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:11.158603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:11.158603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:11.158603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:11.158603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:11.158603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:11.158603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:11.158603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:11.158603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:11.158603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:11.158603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:11.159701 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:11.159701 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:11.159701 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:11.159701 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:11.159701 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:11.159701 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:11.159701 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:11.159701 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:11.159701 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:11.159701 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:11.159701 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:44:11.159701 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:11.159701 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 207/410] 10.222.0.18 () {56 vars in 1096 bytes} [Mon May 2 08:44:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:11.161270 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2a9f5-0b8f-46e1-9e21-0a898da3b7c8 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:11.215348 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b22dca-7959-4acc-b9c5-8258fe60546c None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:11.264933 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2a9f5-0b8f-46e1-9e21-0a898da3b7c8 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:11.269373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570a6d3-e467-43eb-b14e-a961470371aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:11.270426 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570a6d3-e467-43eb-b14e-a961470371aa None admin] REQUEST_METHOD: `PUT` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:11.270850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570a6d3-e467-43eb-b14e-a961470371aa None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:11.271283 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570a6d3-e467-43eb-b14e-a961470371aa None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1/groups/df25a59a7e854ed9ad64629f06284bee/roles/b860fb30a96b4b2ea790453a2a4f6044` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:11.280979 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570a6d3-e467-43eb-b14e-a961470371aa None admin] RBAC: Authorizing `identity:create_grant(project_id=8308537c26a949d68d16cd15829ed9e1, group_id=df25a59a7e854ed9ad64629f06284bee, role_id=b860fb30a96b4b2ea790453a2a4f6044)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:11.282722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570a6d3-e467-43eb-b14e-a961470371aa None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:11.300760 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf1954-649e-46f0-a1e8-98fbfd1e8d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:11.301693 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf1954-649e-46f0-a1e8-98fbfd1e8d36 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:11.302080 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf1954-649e-46f0-a1e8-98fbfd1e8d36 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:11.302518 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf1954-649e-46f0-a1e8-98fbfd1e8d36 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:11.303452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf1954-649e-46f0-a1e8-98fbfd1e8d36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:11.303881 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf1954-649e-46f0-a1e8-98fbfd1e8d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:11.305398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf1954-649e-46f0-a1e8-98fbfd1e8d36 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:11.317151 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 208/411] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:11.322951 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf1954-649e-46f0-a1e8-98fbfd1e8d36 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:11.387942 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 204/412] 10.222.0.18 () {58 vars in 1442 bytes} [Mon May 2 08:44:11 2022] PUT /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1/groups/df25a59a7e854ed9ad64629f06284bee/roles/b860fb30a96b4b2ea790453a2a4f6044 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 08:44:11.431581 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf1954-649e-46f0-a1e8-98fbfd1e8d36 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:11.470907 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593d907-1abb-49ae-94a9-605ad593736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:11.471781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593d907-1abb-49ae-94a9-605ad593736f None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:11.472072 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593d907-1abb-49ae-94a9-605ad593736f None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:11.472516 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593d907-1abb-49ae-94a9-605ad593736f None admin] PATH_INFO: `/v3/groups/ac61443c4a3c4acd9492d162e53ff481` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:11.473815 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593d907-1abb-49ae-94a9-605ad593736f None admin] RBAC: Authorizing `identity:get_group(group_id=ac61443c4a3c4acd9492d162e53ff481)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:11.475288 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593d907-1abb-49ae-94a9-605ad593736f None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:11.477310 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 209/413] 10.222.0.18 () {56 vars in 1180 bytes} [Mon May 2 08:44:11 2022] GET /identity/v3/groups/ac61443c4a3c4acd9492d162e53ff481 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:11.483724 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570a6d3-e467-43eb-b14e-a961470371aa None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:11.597633 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a18db-e46f-4532-8bd6-7aff0611ca70 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:11.598009 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a18db-e46f-4532-8bd6-7aff0611ca70 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:11.598393 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a18db-e46f-4532-8bd6-7aff0611ca70 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:11.599857 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 210/414] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:44:11.604800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f27cc6-e539-4562-b1df-4841ddc2611c None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:11.605216 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f27cc6-e539-4562-b1df-4841ddc2611c None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:11.605604 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f27cc6-e539-4562-b1df-4841ddc2611c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:11.628966 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570a6d3-e467-43eb-b14e-a961470371aa None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:11.633768 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-69f27cc6-e539-4562-b1df-4841ddc2611c None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:11.633768 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-69f27cc6-e539-4562-b1df-4841ddc2611c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:11.689001 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955f74c-aaff-4161-95ba-3aacdb2dff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:11.690472 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955f74c-aaff-4161-95ba-3aacdb2dff3e None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:11.691042 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955f74c-aaff-4161-95ba-3aacdb2dff3e None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:11.691422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955f74c-aaff-4161-95ba-3aacdb2dff3e None admin] PATH_INFO: `/v3/projects/551938bc45944ca2b1d6b90c735fdb29` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:11.693362 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955f74c-aaff-4161-95ba-3aacdb2dff3e None admin] RBAC: Authorizing `identity:get_project(project_id=551938bc45944ca2b1d6b90c735fdb29)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:11.694929 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955f74c-aaff-4161-95ba-3aacdb2dff3e None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:11.697544 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 205/415] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:44:11 2022] GET /identity/v3/projects/551938bc45944ca2b1d6b90c735fdb29 => generated 344 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:11.703238 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955f74c-aaff-4161-95ba-3aacdb2dff3e None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:11.745568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 211/416] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:44:11.771713 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f27cc6-e539-4562-b1df-4841ddc2611c None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:11.818552 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955f74c-aaff-4161-95ba-3aacdb2dff3e None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:11.854487 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9571162-a04f-4363-ae17-2f316b6516ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:11.855523 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9571162-a04f-4363-ae17-2f316b6516ef None admin] REQUEST_METHOD: `PUT` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:11.855905 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9571162-a04f-4363-ae17-2f316b6516ef None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:11.856308 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9571162-a04f-4363-ae17-2f316b6516ef None admin] PATH_INFO: `/v3/projects/551938bc45944ca2b1d6b90c735fdb29/groups/ac61443c4a3c4acd9492d162e53ff481/roles/509216a314244b96b05d3fe56b0d9cd1` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:11.858903 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9571162-a04f-4363-ae17-2f316b6516ef None admin] RBAC: Authorizing `identity:create_grant(project_id=551938bc45944ca2b1d6b90c735fdb29, group_id=ac61443c4a3c4acd9492d162e53ff481, role_id=509216a314244b96b05d3fe56b0d9cd1)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:11.860493 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9571162-a04f-4363-ae17-2f316b6516ef None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:11.917256 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f27cc6-e539-4562-b1df-4841ddc2611c None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:11.954128 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d75d8-325c-4186-a190-14312e4cb192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:11.955263 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d75d8-325c-4186-a190-14312e4cb192 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:11.955722 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d75d8-325c-4186-a190-14312e4cb192 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:11.956204 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d75d8-325c-4186-a190-14312e4cb192 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:11.966784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d75d8-325c-4186-a190-14312e4cb192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:11.977374 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 206/417] 10.222.0.18 () {58 vars in 1442 bytes} [Mon May 2 08:44:11 2022] PUT /identity/v3/projects/551938bc45944ca2b1d6b90c735fdb29/groups/ac61443c4a3c4acd9492d162e53ff481/roles/509216a314244b96b05d3fe56b0d9cd1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 08:44:11.983969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-732d75d8-325c-4186-a190-14312e4cb192 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 08:44:11.983969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:11.983969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:11.983969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:11.983969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:11.983969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:11.983969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:11.983969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:11.983969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:11.983969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:11.983969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:11.983969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:11.983969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:11.983969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:11.983969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:11.983969 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:11.985039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:11.985039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:11.985039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:11.985039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:11.985039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:11.985039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:11.985039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:11.985039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:11.985039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:11.985039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:11.985039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:11.985039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:11.985039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:11.985039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:11.985039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:11.985039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:11.985847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:11.985847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:11.985847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:11.985847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:11.985847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:11.985847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:11.985847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:11.985847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:11.985847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:11.985847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:11.985847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 08:44:11.985847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:11.988607 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 212/418] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:11.996464 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9571162-a04f-4363-ae17-2f316b6516ef None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:12.119137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9571162-a04f-4363-ae17-2f316b6516ef None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:12.156471 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463bff5-fb34-4042-837b-fc7963d2ed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:12.157436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463bff5-fb34-4042-837b-fc7963d2ed7c None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:12.157857 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463bff5-fb34-4042-837b-fc7963d2ed7c None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:12.158293 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463bff5-fb34-4042-837b-fc7963d2ed7c None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:12.159192 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463bff5-fb34-4042-837b-fc7963d2ed7c None admin] RBAC: Adding query filter params (name=member) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:12.159644 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463bff5-fb34-4042-837b-fc7963d2ed7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:12.161278 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463bff5-fb34-4042-837b-fc7963d2ed7c None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:12.171622 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 207/419] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:44:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:12.177190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d75d8-325c-4186-a190-14312e4cb192 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:12.311374 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d75d8-325c-4186-a190-14312e4cb192 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:12.351105 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d023d-4294-452e-8cd7-53379198db36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:12.351760 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d023d-4294-452e-8cd7-53379198db36 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:12.352041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d023d-4294-452e-8cd7-53379198db36 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:12.352338 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d023d-4294-452e-8cd7-53379198db36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:12.447977 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d023d-4294-452e-8cd7-53379198db36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:12.449467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d023d-4294-452e-8cd7-53379198db36 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:12.582963 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 213/420] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 02 08:44:12.588211 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463bff5-fb34-4042-837b-fc7963d2ed7c None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:12.707824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463bff5-fb34-4042-837b-fc7963d2ed7c None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:12.741968 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d935509-6652-4be9-9061-c77738e54826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:12.743176 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d935509-6652-4be9-9061-c77738e54826 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:12.743675 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d935509-6652-4be9-9061-c77738e54826 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:12.744198 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d935509-6652-4be9-9061-c77738e54826 None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:12.745583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d935509-6652-4be9-9061-c77738e54826 None admin] RBAC: Authorizing `identity:get_project(project_id=5f507bcdfd314874b0a378d7037ed855)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:12.747235 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d935509-6652-4be9-9061-c77738e54826 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:12.749235 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 208/421] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:44:12 2022] GET /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:12.756074 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d023d-4294-452e-8cd7-53379198db36 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:12.899304 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d023d-4294-452e-8cd7-53379198db36 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:12.942562 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f28b7a-0c18-48f6-bbb9-15f81b5a31f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:12.943422 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f28b7a-0c18-48f6-bbb9-15f81b5a31f2 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:12.943701 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f28b7a-0c18-48f6-bbb9-15f81b5a31f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:12.943976 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f28b7a-0c18-48f6-bbb9-15f81b5a31f2 None admin] PATH_INFO: `/v3/groups/df25a59a7e854ed9ad64629f06284bee` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:12.947650 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f28b7a-0c18-48f6-bbb9-15f81b5a31f2 None admin] RBAC: Authorizing `identity:get_group(group_id=df25a59a7e854ed9ad64629f06284bee)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:12.949171 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f28b7a-0c18-48f6-bbb9-15f81b5a31f2 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:12.951257 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 214/422] 10.222.0.18 () {56 vars in 1180 bytes} [Mon May 2 08:44:12 2022] GET /identity/v3/groups/df25a59a7e854ed9ad64629f06284bee => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:12.957727 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d935509-6652-4be9-9061-c77738e54826 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:13.124644 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d935509-6652-4be9-9061-c77738e54826 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:13.163048 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb485e-7f13-445b-aaef-d1b3acf52646 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:13.163383 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb485e-7f13-445b-aaef-d1b3acf52646 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:13.163591 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb485e-7f13-445b-aaef-d1b3acf52646 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:13.165242 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 215/423] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:13.173677 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b9013-3729-4f2e-8bbe-85f12a3f2d84 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:13.173677 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b9013-3729-4f2e-8bbe-85f12a3f2d84 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:13.173677 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b9013-3729-4f2e-8bbe-85f12a3f2d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:13.176016 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16994d38-b1d2-4c7d-882b-111e128c4acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:13.176699 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16994d38-b1d2-4c7d-882b-111e128c4acc None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:13.176977 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16994d38-b1d2-4c7d-882b-111e128c4acc None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:13.177245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16994d38-b1d2-4c7d-882b-111e128c4acc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:13.178070 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16994d38-b1d2-4c7d-882b-111e128c4acc None admin] RBAC: Adding query filter params (group.id=df25a59a7e854ed9ad64629f06284bee, role.id=722968fb4ca44c1795d61c44f61a78d9, scope.project.id=5f507bcdfd314874b0a378d7037ed855) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:13.178379 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16994d38-b1d2-4c7d-882b-111e128c4acc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:13.179837 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16994d38-b1d2-4c7d-882b-111e128c4acc None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:13.199087 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 209/424] 10.222.0.18 () {56 vars in 1376 bytes} [Mon May 2 08:44:12 2022] GET /identity/v3/role_assignments?group.id=df25a59a7e854ed9ad64629f06284bee&scope.project.id=5f507bcdfd314874b0a378d7037ed855&role.id=722968fb4ca44c1795d61c44f61a78d9 => generated 611 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:13.200063 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-658b9013-3729-4f2e-8bbe-85f12a3f2d84 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:13.201352 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-658b9013-3729-4f2e-8bbe-85f12a3f2d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:13.294498 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 216/425] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:44:13.332197 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16994d38-b1d2-4c7d-882b-111e128c4acc None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:13.471687 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16994d38-b1d2-4c7d-882b-111e128c4acc None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:13.505563 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055821e-883d-4960-8beb-5dadcf05ad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:13.506364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055821e-883d-4960-8beb-5dadcf05ad4d None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:13.506646 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055821e-883d-4960-8beb-5dadcf05ad4d None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:13.506918 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055821e-883d-4960-8beb-5dadcf05ad4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:13.518074 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055821e-883d-4960-8beb-5dadcf05ad4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:13.526261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-2055821e-883d-4960-8beb-5dadcf05ad4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 08:44:13.526261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:13.526261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:13.526261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:13.526261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:13.526261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:13.526261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:13.526261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:13.526261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:13.526261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:13.526261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:13.526261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:13.526261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:13.526261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:13.526261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:13.526261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:13.527579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:13.527579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:13.527579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:13.527579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:13.527579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:13.527579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:13.527579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:13.527579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:13.527579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:13.527579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:13.527579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:13.527579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:13.527579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:13.527579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:13.527579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:13.527579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:13.530150 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:13.530150 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:13.530150 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:13.530150 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:13.530150 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:13.530150 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:13.530150 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:13.530150 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:13.530150 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:13.530150 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:13.530150 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 08:44:13.530150 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:13.530150 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 210/426] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:13.534534 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b9013-3729-4f2e-8bbe-85f12a3f2d84 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:13.660991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b9013-3729-4f2e-8bbe-85f12a3f2d84 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:13.701065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287682e2-13e3-42cd-bc5b-113c2691036e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:13.701812 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287682e2-13e3-42cd-bc5b-113c2691036e None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:13.702097 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287682e2-13e3-42cd-bc5b-113c2691036e None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:13.702369 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287682e2-13e3-42cd-bc5b-113c2691036e None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:13.703123 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287682e2-13e3-42cd-bc5b-113c2691036e None admin] RBAC: Adding query filter params (name=member) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:13.703430 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287682e2-13e3-42cd-bc5b-113c2691036e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:13.704839 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287682e2-13e3-42cd-bc5b-113c2691036e None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:13.713952 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 217/427] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:44:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:13.720604 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055821e-883d-4960-8beb-5dadcf05ad4d None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:13.753637 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7c5e0-03ca-414f-9cc1-490ec1d6c168 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:13.753637 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7c5e0-03ca-414f-9cc1-490ec1d6c168 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:13.753637 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7c5e0-03ca-414f-9cc1-490ec1d6c168 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:13.755102 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 218/428] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:13.760627 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33371033-ba4b-42b5-9991-d7e1baf2c790 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:13.760917 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33371033-ba4b-42b5-9991-d7e1baf2c790 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:13.761262 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33371033-ba4b-42b5-9991-d7e1baf2c790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:13.779205 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-33371033-ba4b-42b5-9991-d7e1baf2c790 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:13.781060 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-33371033-ba4b-42b5-9991-d7e1baf2c790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:13.852746 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055821e-883d-4960-8beb-5dadcf05ad4d None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:13.861742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 219/429] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:44:13.886546 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33371033-ba4b-42b5-9991-d7e1baf2c790 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:13.891856 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb169f24-2d74-48ba-af71-b29b4c981583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:13.892734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb169f24-2d74-48ba-af71-b29b4c981583 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:13.893215 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb169f24-2d74-48ba-af71-b29b4c981583 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:13.893633 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb169f24-2d74-48ba-af71-b29b4c981583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:13.988529 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb169f24-2d74-48ba-af71-b29b4c981583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:13.990779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb169f24-2d74-48ba-af71-b29b4c981583 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:14.007034 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33371033-ba4b-42b5-9991-d7e1baf2c790 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:14.043795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222ebde-6010-4e70-8ea7-564111c18d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:14.044920 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222ebde-6010-4e70-8ea7-564111c18d86 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:14.045699 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222ebde-6010-4e70-8ea7-564111c18d86 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:14.046267 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222ebde-6010-4e70-8ea7-564111c18d86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:14.058615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222ebde-6010-4e70-8ea7-564111c18d86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:14.067386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-4222ebde-6010-4e70-8ea7-564111c18d86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:44:14.067386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:14.067386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:14.067386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:14.067386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:14.067386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:14.067386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:14.067386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:14.067386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:14.067386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:14.067386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:14.067386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:14.067386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:14.067386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:14.067386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:14.067386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:14.068339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:14.068339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:14.068339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:14.068339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:14.068339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:14.068339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:14.068339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:14.068339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:14.068339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:14.068339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:14.068339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:14.068339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:14.068339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:14.068339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:14.068339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:14.068339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:14.069104 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:14.069104 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:14.069104 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:14.069104 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:14.069104 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:14.069104 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:14.069104 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:14.069104 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:14.069104 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:14.069104 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:14.069104 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:44:14.069104 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:14.070389 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 220/430] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:44:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:14.076909 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222ebde-6010-4e70-8ea7-564111c18d86 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:14.116261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 211/431] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:44:14.125103 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb169f24-2d74-48ba-af71-b29b4c981583 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:14.201970 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222ebde-6010-4e70-8ea7-564111c18d86 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:14.243057 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb169f24-2d74-48ba-af71-b29b4c981583 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:14.251050 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bcb1e-11ea-454a-af90-72baca8f2816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:14.252440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bcb1e-11ea-454a-af90-72baca8f2816 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:14.252877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bcb1e-11ea-454a-af90-72baca8f2816 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:14.253303 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bcb1e-11ea-454a-af90-72baca8f2816 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:14.254644 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bcb1e-11ea-454a-af90-72baca8f2816 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:14.255112 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bcb1e-11ea-454a-af90-72baca8f2816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:14.257352 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bcb1e-11ea-454a-af90-72baca8f2816 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:14.269133 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 221/432] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:14.274602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bcb1e-11ea-454a-af90-72baca8f2816 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:14.282738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be669e-5e71-4882-b024-a96862b47fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:14.283779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be669e-5e71-4882-b024-a96862b47fe6 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:14.284208 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be669e-5e71-4882-b024-a96862b47fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:14.284592 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be669e-5e71-4882-b024-a96862b47fe6 None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:14.286313 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be669e-5e71-4882-b024-a96862b47fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=8308537c26a949d68d16cd15829ed9e1)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:14.287469 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be669e-5e71-4882-b024-a96862b47fe6 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:14.289640 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 212/433] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:44:14 2022] GET /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:14.294905 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be669e-5e71-4882-b024-a96862b47fe6 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:14.387053 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bcb1e-11ea-454a-af90-72baca8f2816 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:14.395618 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be669e-5e71-4882-b024-a96862b47fe6 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:14.422916 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462b5d4-65d7-42fd-aebc-412cc4111298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:14.423830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462b5d4-65d7-42fd-aebc-412cc4111298 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:14.424396 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462b5d4-65d7-42fd-aebc-412cc4111298 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:14.424853 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462b5d4-65d7-42fd-aebc-412cc4111298 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:14.431215 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff8598-d30a-4742-9a79-b0cbd34b32c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:14.433432 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff8598-d30a-4742-9a79-b0cbd34b32c8 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:14.433432 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff8598-d30a-4742-9a79-b0cbd34b32c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:14.433432 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff8598-d30a-4742-9a79-b0cbd34b32c8 None admin] PATH_INFO: `/v3/groups/df25a59a7e854ed9ad64629f06284bee` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:14.435133 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff8598-d30a-4742-9a79-b0cbd34b32c8 None admin] RBAC: Authorizing `identity:get_group(group_id=df25a59a7e854ed9ad64629f06284bee)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:14.437144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff8598-d30a-4742-9a79-b0cbd34b32c8 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:14.438839 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 213/434] 10.222.0.18 () {56 vars in 1180 bytes} [Mon May 2 08:44:14 2022] GET /identity/v3/groups/df25a59a7e854ed9ad64629f06284bee => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:14.439980 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9cda5-4d6f-4af5-9c54-d255221e1e54 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:14.440292 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9cda5-4d6f-4af5-9c54-d255221e1e54 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:14.440569 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9cda5-4d6f-4af5-9c54-d255221e1e54 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:14.444134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 214/435] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:14.453571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9cda5-4d6f-4af5-9c54-d255221e1e54 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:14.506852 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462b5d4-65d7-42fd-aebc-412cc4111298 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:14.508400 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462b5d4-65d7-42fd-aebc-412cc4111298 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:14.549000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9cda5-4d6f-4af5-9c54-d255221e1e54 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:14.585090 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73511ab-a26b-48dd-aa4e-e6f0f2bd46a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:14.585745 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73511ab-a26b-48dd-aa4e-e6f0f2bd46a7 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:14.586019 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73511ab-a26b-48dd-aa4e-e6f0f2bd46a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:14.586292 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73511ab-a26b-48dd-aa4e-e6f0f2bd46a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:14.587158 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73511ab-a26b-48dd-aa4e-e6f0f2bd46a7 None admin] RBAC: Adding query filter params (group.id=df25a59a7e854ed9ad64629f06284bee, role.id=722968fb4ca44c1795d61c44f61a78d9, scope.project.id=8308537c26a949d68d16cd15829ed9e1) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:14.587469 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73511ab-a26b-48dd-aa4e-e6f0f2bd46a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:14.588957 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73511ab-a26b-48dd-aa4e-e6f0f2bd46a7 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:14.600450 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 215/436] 10.222.0.18 () {56 vars in 1376 bytes} [Mon May 2 08:44:14 2022] GET /identity/v3/role_assignments?group.id=df25a59a7e854ed9ad64629f06284bee&scope.project.id=8308537c26a949d68d16cd15829ed9e1&role.id=722968fb4ca44c1795d61c44f61a78d9 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:14.602661 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba03a6-e1cc-4234-a7bc-b971b33bf87e None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:14.603187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba03a6-e1cc-4234-a7bc-b971b33bf87e None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:14.604067 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba03a6-e1cc-4234-a7bc-b971b33bf87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:14.609161 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 222/437] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 02 08:44:14.614851 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462b5d4-65d7-42fd-aebc-412cc4111298 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:14.626730 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-96ba03a6-e1cc-4234-a7bc-b971b33bf87e None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:14.628753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-96ba03a6-e1cc-4234-a7bc-b971b33bf87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:14.728453 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 216/438] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:14.750194 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462b5d4-65d7-42fd-aebc-412cc4111298 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:14.751134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba03a6-e1cc-4234-a7bc-b971b33bf87e None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:14.795932 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc988918-a283-40fe-a332-fe9e06170401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:14.796836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc988918-a283-40fe-a332-fe9e06170401 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:14.797119 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc988918-a283-40fe-a332-fe9e06170401 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:14.797395 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc988918-a283-40fe-a332-fe9e06170401 None admin] PATH_INFO: `/v3/projects/5f507bcdfd314874b0a378d7037ed855` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:14.798636 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc988918-a283-40fe-a332-fe9e06170401 None admin] RBAC: Authorizing `identity:get_project(project_id=5f507bcdfd314874b0a378d7037ed855)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:14.800629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc988918-a283-40fe-a332-fe9e06170401 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:14.803233 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 223/439] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:44:14 2022] GET /identity/v3/projects/5f507bcdfd314874b0a378d7037ed855 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:14.808854 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc988918-a283-40fe-a332-fe9e06170401 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:14.875717 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba03a6-e1cc-4234-a7bc-b971b33bf87e None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:14.913037 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837defa8-46e1-44ba-b5a3-98cfa6b7da59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:14.913855 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837defa8-46e1-44ba-b5a3-98cfa6b7da59 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:14.914137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837defa8-46e1-44ba-b5a3-98cfa6b7da59 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:14.914413 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837defa8-46e1-44ba-b5a3-98cfa6b7da59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:14.924460 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837defa8-46e1-44ba-b5a3-98cfa6b7da59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:14.929341 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc988918-a283-40fe-a332-fe9e06170401 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:14.932509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-837defa8-46e1-44ba-b5a3-98cfa6b7da59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:44:14.932509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:14.932509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:14.932509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:14.932509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:14.932509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:14.932509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:14.932509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:14.932509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:14.932509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:14.932509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:14.932509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:14.932509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:14.932509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:14.932509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:14.932509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:14.933422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:14.933422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:14.933422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:14.933422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:14.933422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:14.933422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:14.933422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:14.933422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:14.933422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:14.933422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:14.933422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:14.933422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:14.933422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:14.933422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:14.933422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:14.933422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:14.934592 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:14.934592 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:14.934592 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:14.934592 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:14.934592 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:14.934592 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:14.934592 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:14.934592 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:14.934592 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:14.934592 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:14.934592 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 08:44:14.934592 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:14.934592 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 217/440] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:44:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:14.939971 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837defa8-46e1-44ba-b5a3-98cfa6b7da59 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:14.965299 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d49513-517f-47bf-aa40-97fc745a5d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:14.966151 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d49513-517f-47bf-aa40-97fc745a5d0b None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:14.966438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d49513-517f-47bf-aa40-97fc745a5d0b None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:14.966705 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d49513-517f-47bf-aa40-97fc745a5d0b None admin] PATH_INFO: `/v3/groups/df25a59a7e854ed9ad64629f06284bee` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:14.968508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d49513-517f-47bf-aa40-97fc745a5d0b None admin] RBAC: Authorizing `identity:get_group(group_id=df25a59a7e854ed9ad64629f06284bee)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:14.969957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d49513-517f-47bf-aa40-97fc745a5d0b None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:14.971558 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 224/441] 10.222.0.18 () {56 vars in 1180 bytes} [Mon May 2 08:44:14 2022] GET /identity/v3/groups/df25a59a7e854ed9ad64629f06284bee => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:14.972795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cbad8-97a8-4e5e-bd74-86c2ab8aa1fd None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:14.973080 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cbad8-97a8-4e5e-bd74-86c2ab8aa1fd None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:14.973353 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cbad8-97a8-4e5e-bd74-86c2ab8aa1fd None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:14.974695 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 225/442] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:14.978124 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cbad8-97a8-4e5e-bd74-86c2ab8aa1fd None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:15.035120 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837defa8-46e1-44ba-b5a3-98cfa6b7da59 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:15.065918 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bc3db-0122-4482-bdec-ee0b3ca4a7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:15.066512 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bc3db-0122-4482-bdec-ee0b3ca4a7c5 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:15.066789 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bc3db-0122-4482-bdec-ee0b3ca4a7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:15.067057 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bc3db-0122-4482-bdec-ee0b3ca4a7c5 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:15.067790 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bc3db-0122-4482-bdec-ee0b3ca4a7c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:15.068120 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bc3db-0122-4482-bdec-ee0b3ca4a7c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:15.069490 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bc3db-0122-4482-bdec-ee0b3ca4a7c5 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:15.072794 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cbad8-97a8-4e5e-bd74-86c2ab8aa1fd None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:15.077818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 218/443] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:15.079134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0522b30-8b66-48b7-9354-ab5ddff8e239 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:15.079424 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0522b30-8b66-48b7-9354-ab5ddff8e239 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:15.079700 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0522b30-8b66-48b7-9354-ab5ddff8e239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:15.095250 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-d0522b30-8b66-48b7-9354-ab5ddff8e239 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:15.096453 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-d0522b30-8b66-48b7-9354-ab5ddff8e239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:15.108535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a895b81-de27-48a7-a2a1-77d629089284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:15.109177 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a895b81-de27-48a7-a2a1-77d629089284 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:15.109460 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a895b81-de27-48a7-a2a1-77d629089284 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:15.109731 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a895b81-de27-48a7-a2a1-77d629089284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:15.110547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a895b81-de27-48a7-a2a1-77d629089284 None admin] RBAC: Adding query filter params (group.id=df25a59a7e854ed9ad64629f06284bee, role.id=b860fb30a96b4b2ea790453a2a4f6044, scope.project.id=5f507bcdfd314874b0a378d7037ed855) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:15.110854 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a895b81-de27-48a7-a2a1-77d629089284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:15.112388 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a895b81-de27-48a7-a2a1-77d629089284 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:15.117996 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 226/444] 10.222.0.18 () {56 vars in 1376 bytes} [Mon May 2 08:44:14 2022] GET /identity/v3/role_assignments?group.id=df25a59a7e854ed9ad64629f06284bee&scope.project.id=5f507bcdfd314874b0a378d7037ed855&role.id=b860fb30a96b4b2ea790453a2a4f6044 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:15.118760 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a895b81-de27-48a7-a2a1-77d629089284 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:15.163379 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 219/445] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:15.188182 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0522b30-8b66-48b7-9354-ab5ddff8e239 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:15.236579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a895b81-de27-48a7-a2a1-77d629089284 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:15.270848 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b6e59-b3d6-4d27-a50a-d86552c1765c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:15.271508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b6e59-b3d6-4d27-a50a-d86552c1765c None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:15.271798 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b6e59-b3d6-4d27-a50a-d86552c1765c None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:15.272095 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b6e59-b3d6-4d27-a50a-d86552c1765c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:15.290112 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0522b30-8b66-48b7-9354-ab5ddff8e239 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:15.328627 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb0782-4630-4c64-b5ab-3e7adb0449a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:15.329449 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb0782-4630-4c64-b5ab-3e7adb0449a8 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:15.329731 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb0782-4630-4c64-b5ab-3e7adb0449a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:15.329999 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb0782-4630-4c64-b5ab-3e7adb0449a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:15.340134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb0782-4630-4c64-b5ab-3e7adb0449a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:15.349290 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b6e59-b3d6-4d27-a50a-d86552c1765c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:15.349429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-39eb0782-4630-4c64-b5ab-3e7adb0449a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:44:15.349429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:15.349429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:15.349429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:15.349429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:15.349429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:15.349429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:15.349429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:15.349429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:15.349429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:15.349429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:15.349429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:15.349429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:15.349429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:15.349429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:15.349429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:15.350272 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:15.350272 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:15.350272 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:15.350272 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:15.350272 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:15.350272 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:15.350272 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:15.350272 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:15.350272 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:15.350272 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:15.350272 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:15.350272 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:15.350272 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:15.350272 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:15.350272 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:15.350272 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:15.351053 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:15.351053 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:15.351053 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:15.351053 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:15.351053 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:15.351053 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:15.351053 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:15.351053 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:15.351053 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:15.351053 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:15.351053 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:44:15.351053 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:15.351669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b6e59-b3d6-4d27-a50a-d86552c1765c None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:15.351750 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 220/446] 10.222.0.18 () {56 vars in 1096 bytes} [Mon May 2 08:44:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:15.356159 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb0782-4630-4c64-b5ab-3e7adb0449a8 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:15.459069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 227/447] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:44:15.461337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb0782-4630-4c64-b5ab-3e7adb0449a8 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:15.465819 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b6e59-b3d6-4d27-a50a-d86552c1765c None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:15.498955 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934da0a4-5b39-4134-b5a9-3423af316cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:15.499818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934da0a4-5b39-4134-b5a9-3423af316cc4 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:15.500181 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934da0a4-5b39-4134-b5a9-3423af316cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:15.500463 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934da0a4-5b39-4134-b5a9-3423af316cc4 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:15.501219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934da0a4-5b39-4134-b5a9-3423af316cc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:15.501528 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934da0a4-5b39-4134-b5a9-3423af316cc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:15.502931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934da0a4-5b39-4134-b5a9-3423af316cc4 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:15.511644 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 221/448] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:15.517882 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934da0a4-5b39-4134-b5a9-3423af316cc4 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:15.577502 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b6e59-b3d6-4d27-a50a-d86552c1765c None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:15.612772 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203638eb-3b31-43ff-b44b-b903f6ec4684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:15.613565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203638eb-3b31-43ff-b44b-b903f6ec4684 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:15.613847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203638eb-3b31-43ff-b44b-b903f6ec4684 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:15.614118 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203638eb-3b31-43ff-b44b-b903f6ec4684 None admin] PATH_INFO: `/v3/projects/8308537c26a949d68d16cd15829ed9e1` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:15.615746 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203638eb-3b31-43ff-b44b-b903f6ec4684 None admin] RBAC: Authorizing `identity:get_project(project_id=8308537c26a949d68d16cd15829ed9e1)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:15.618063 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203638eb-3b31-43ff-b44b-b903f6ec4684 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:15.620858 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 228/449] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:44:15 2022] GET /identity/v3/projects/8308537c26a949d68d16cd15829ed9e1 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:15.622108 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934da0a4-5b39-4134-b5a9-3423af316cc4 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:15.626639 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203638eb-3b31-43ff-b44b-b903f6ec4684 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:15.660975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da97a08-7c87-48d1-9710-2ff8098ce270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:15.661646 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da97a08-7c87-48d1-9710-2ff8098ce270 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:15.661930 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da97a08-7c87-48d1-9710-2ff8098ce270 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:15.662211 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da97a08-7c87-48d1-9710-2ff8098ce270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:15.731069 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da97a08-7c87-48d1-9710-2ff8098ce270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:15.732678 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da97a08-7c87-48d1-9710-2ff8098ce270 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:15.735540 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203638eb-3b31-43ff-b44b-b903f6ec4684 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:15.767925 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152b10d-0f18-4233-89f1-0188b74776c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:15.768808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152b10d-0f18-4233-89f1-0188b74776c9 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:15.769087 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152b10d-0f18-4233-89f1-0188b74776c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:15.769367 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152b10d-0f18-4233-89f1-0188b74776c9 None admin] PATH_INFO: `/v3/groups/df25a59a7e854ed9ad64629f06284bee` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:15.770551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152b10d-0f18-4233-89f1-0188b74776c9 None admin] RBAC: Authorizing `identity:get_group(group_id=df25a59a7e854ed9ad64629f06284bee)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:15.772000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152b10d-0f18-4233-89f1-0188b74776c9 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:15.773637 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 229/450] 10.222.0.18 () {56 vars in 1180 bytes} [Mon May 2 08:44:15 2022] GET /identity/v3/groups/df25a59a7e854ed9ad64629f06284bee => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:15.785618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152b10d-0f18-4233-89f1-0188b74776c9 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:15.826003 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 222/451] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:44:15.831494 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da97a08-7c87-48d1-9710-2ff8098ce270 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:15.876037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152b10d-0f18-4233-89f1-0188b74776c9 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:15.908257 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ecc35-40f2-4966-8e14-91b49ff9d3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:15.908896 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ecc35-40f2-4966-8e14-91b49ff9d3ed None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:15.909175 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ecc35-40f2-4966-8e14-91b49ff9d3ed None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:15.909445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ecc35-40f2-4966-8e14-91b49ff9d3ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:15.910255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ecc35-40f2-4966-8e14-91b49ff9d3ed None admin] RBAC: Adding query filter params (group.id=df25a59a7e854ed9ad64629f06284bee, role.id=b860fb30a96b4b2ea790453a2a4f6044, scope.project.id=8308537c26a949d68d16cd15829ed9e1) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:15.910561 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ecc35-40f2-4966-8e14-91b49ff9d3ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:15.912014 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ecc35-40f2-4966-8e14-91b49ff9d3ed None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:15.917604 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 230/452] 10.222.0.18 () {56 vars in 1376 bytes} [Mon May 2 08:44:15 2022] GET /identity/v3/role_assignments?group.id=df25a59a7e854ed9ad64629f06284bee&scope.project.id=8308537c26a949d68d16cd15829ed9e1&role.id=b860fb30a96b4b2ea790453a2a4f6044 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:15.925065 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da97a08-7c87-48d1-9710-2ff8098ce270 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:15.961118 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f77bf-172e-406f-a3ee-e18f8ce81174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:15.962000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f77bf-172e-406f-a3ee-e18f8ce81174 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:15.962278 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f77bf-172e-406f-a3ee-e18f8ce81174 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:15.962547 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f77bf-172e-406f-a3ee-e18f8ce81174 None admin] PATH_INFO: `/v3/projects/551938bc45944ca2b1d6b90c735fdb29` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:15.963768 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f77bf-172e-406f-a3ee-e18f8ce81174 None admin] RBAC: Authorizing `identity:get_project(project_id=551938bc45944ca2b1d6b90c735fdb29)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:15.965266 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f77bf-172e-406f-a3ee-e18f8ce81174 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:15.967037 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 223/453] 10.222.0.18 () {56 vars in 1186 bytes} [Mon May 2 08:44:15 2022] GET /identity/v3/projects/551938bc45944ca2b1d6b90c735fdb29 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:15.972815 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ecc35-40f2-4966-8e14-91b49ff9d3ed None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:16.075364 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ecc35-40f2-4966-8e14-91b49ff9d3ed None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:16.108373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a0a3a-3c5b-4cfa-a76a-c4469f766538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:16.109209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a0a3a-3c5b-4cfa-a76a-c4469f766538 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:16.109488 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a0a3a-3c5b-4cfa-a76a-c4469f766538 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:16.109757 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a0a3a-3c5b-4cfa-a76a-c4469f766538 None admin] PATH_INFO: `/v3/groups/ac61443c4a3c4acd9492d162e53ff481` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:16.110927 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a0a3a-3c5b-4cfa-a76a-c4469f766538 None admin] RBAC: Authorizing `identity:get_group(group_id=ac61443c4a3c4acd9492d162e53ff481)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:16.112396 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a0a3a-3c5b-4cfa-a76a-c4469f766538 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:16.114001 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 231/454] 10.222.0.18 () {56 vars in 1180 bytes} [Mon May 2 08:44:15 2022] GET /identity/v3/groups/ac61443c4a3c4acd9492d162e53ff481 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:16.119855 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f77bf-172e-406f-a3ee-e18f8ce81174 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:16.220134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f77bf-172e-406f-a3ee-e18f8ce81174 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:16.253018 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e7f76-8c4d-4a85-900a-71a2714880bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:16.253676 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e7f76-8c4d-4a85-900a-71a2714880bc None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:16.253963 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e7f76-8c4d-4a85-900a-71a2714880bc None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:16.254241 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e7f76-8c4d-4a85-900a-71a2714880bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:16.255064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e7f76-8c4d-4a85-900a-71a2714880bc None admin] RBAC: Adding query filter params (group.id=ac61443c4a3c4acd9492d162e53ff481, role.id=509216a314244b96b05d3fe56b0d9cd1, scope.project.id=551938bc45944ca2b1d6b90c735fdb29) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:16.255374 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e7f76-8c4d-4a85-900a-71a2714880bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:16.256839 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e7f76-8c4d-4a85-900a-71a2714880bc None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:16.262945 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 224/455] 10.222.0.18 () {56 vars in 1376 bytes} [Mon May 2 08:44:16 2022] GET /identity/v3/role_assignments?group.id=ac61443c4a3c4acd9492d162e53ff481&scope.project.id=551938bc45944ca2b1d6b90c735fdb29&role.id=509216a314244b96b05d3fe56b0d9cd1 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:18.933303 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2dc01-716b-4e80-b371-3d906dc8d058 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:18.934302 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2dc01-716b-4e80-b371-3d906dc8d058 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:18.934793 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2dc01-716b-4e80-b371-3d906dc8d058 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:18.937173 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 232/456] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:18.942632 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80482165-fdb0-4ad0-926f-850a87e0f865 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:18.943504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80482165-fdb0-4ad0-926f-850a87e0f865 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:18.943983 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80482165-fdb0-4ad0-926f-850a87e0f865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:18.962535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-80482165-fdb0-4ad0-926f-850a87e0f865 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:18.964093 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-80482165-fdb0-4ad0-926f-850a87e0f865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:19.035780 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 225/457] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:19.050400 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977c522-938a-479a-8fe2-48196c0f4bc6 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:19.050709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977c522-938a-479a-8fe2-48196c0f4bc6 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:19.050965 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977c522-938a-479a-8fe2-48196c0f4bc6 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:19.052474 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 233/458] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:19.057612 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb9e83-f7d7-4d58-ba17-56128121ce9c None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:19.057910 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb9e83-f7d7-4d58-ba17-56128121ce9c None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:19.058189 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb9e83-f7d7-4d58-ba17-56128121ce9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:19.066358 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977c522-938a-479a-8fe2-48196c0f4bc6 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:19.076129 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-f6eb9e83-f7d7-4d58-ba17-56128121ce9c None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:19.077763 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-f6eb9e83-f7d7-4d58-ba17-56128121ce9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:19.145868 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 226/459] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:19.171776 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb9e83-f7d7-4d58-ba17-56128121ce9c None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:19.176686 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977c522-938a-479a-8fe2-48196c0f4bc6 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:19.211500 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d60e8-9e28-43c4-936d-f30ebb9b1e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:19.212251 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d60e8-9e28-43c4-936d-f30ebb9b1e2d None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:19.212532 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d60e8-9e28-43c4-936d-f30ebb9b1e2d None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:19.212805 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d60e8-9e28-43c4-936d-f30ebb9b1e2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:19.223353 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d60e8-9e28-43c4-936d-f30ebb9b1e2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:19.225059 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d60e8-9e28-43c4-936d-f30ebb9b1e2d None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:19.244547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-4e6d60e8-9e28-43c4-936d-f30ebb9b1e2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:19.244547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:19.244547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:19.244547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:19.244547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:19.244547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:19.244547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:19.244547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:19.244547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:19.244547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:19.244547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:19.244547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:19.244547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:19.244547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:19.244547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:19.245615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:19.245615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:19.245615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:19.245615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:19.245615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:19.245615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:19.245615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:19.245615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:19.245615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:19.245615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:19.245615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:19.245615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:19.245615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:19.245615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:19.245615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:19.245615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:19.245615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:19.246709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:19.246709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:19.246709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:19.246709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:19.253029 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 234/460] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:19.253499 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f9a06-7419-40e2-9295-954b87940a71 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:19.253788 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f9a06-7419-40e2-9295-954b87940a71 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:19.254071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f9a06-7419-40e2-9295-954b87940a71 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:19.255348 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 235/461] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:19.256032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f9a06-7419-40e2-9295-954b87940a71 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:19.274147 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb9e83-f7d7-4d58-ba17-56128121ce9c None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:19.308141 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445c6b8-32c4-48a9-96a7-f7dfaa236a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:19.309214 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445c6b8-32c4-48a9-96a7-f7dfaa236a86 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:19.309703 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445c6b8-32c4-48a9-96a7-f7dfaa236a86 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:19.310043 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445c6b8-32c4-48a9-96a7-f7dfaa236a86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:19.322422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445c6b8-32c4-48a9-96a7-f7dfaa236a86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:19.324160 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445c6b8-32c4-48a9-96a7-f7dfaa236a86 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:19.346513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-0445c6b8-32c4-48a9-96a7-f7dfaa236a86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:19.346513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:19.346513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:19.346513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:19.346513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:19.346513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:19.346513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:19.346513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:19.346513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:19.346513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:19.346513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:19.346513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:19.346513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:19.346513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:19.346513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:19.347421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:19.347421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:19.347421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:19.347421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:19.347421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:19.347421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:19.347421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:19.347421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:19.347421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:19.347421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:19.347421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:19.347421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:19.347421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:19.347421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:19.347421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:19.347421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:19.347421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:19.348698 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:19.348698 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:19.348698 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:19.348698 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:19.348698 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 227/462] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:19.350216 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ddc89-0d3c-46ef-96b5-cd780418cb87 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:19.351066 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ddc89-0d3c-46ef-96b5-cd780418cb87 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:19.351066 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ddc89-0d3c-46ef-96b5-cd780418cb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:19.357176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f9a06-7419-40e2-9295-954b87940a71 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:19.367757 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-4d0ddc89-0d3c-46ef-96b5-cd780418cb87 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:19.369463 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-4d0ddc89-0d3c-46ef-96b5-cd780418cb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:19.393269 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7a353-f5e8-40a6-a08a-6bb0bc5b60c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:19.393948 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7a353-f5e8-40a6-a08a-6bb0bc5b60c4 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:19.394238 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7a353-f5e8-40a6-a08a-6bb0bc5b60c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:19.394512 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7a353-f5e8-40a6-a08a-6bb0bc5b60c4 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:19.395248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7a353-f5e8-40a6-a08a-6bb0bc5b60c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:19.395554 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7a353-f5e8-40a6-a08a-6bb0bc5b60c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:19.397016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7a353-f5e8-40a6-a08a-6bb0bc5b60c4 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:19.414068 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 236/463] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:19.414068 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7a353-f5e8-40a6-a08a-6bb0bc5b60c4 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:19.440169 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 228/464] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:19.452334 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ddc89-0d3c-46ef-96b5-cd780418cb87 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:19.519174 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7a353-f5e8-40a6-a08a-6bb0bc5b60c4 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:19.549415 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ddc89-0d3c-46ef-96b5-cd780418cb87 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:19.552227 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d375f-9b72-400e-af3d-dce034facee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:19.552882 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d375f-9b72-400e-af3d-dce034facee2 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:19.553162 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d375f-9b72-400e-af3d-dce034facee2 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:19.553434 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d375f-9b72-400e-af3d-dce034facee2 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:19.554142 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d375f-9b72-400e-af3d-dce034facee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:19.554444 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d375f-9b72-400e-af3d-dce034facee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:19.555816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d375f-9b72-400e-af3d-dce034facee2 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:19.566929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 237/465] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:19.567662 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d375f-9b72-400e-af3d-dce034facee2 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:19.582840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7dc92-1a51-4e51-b9e4-314d69c3c661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:19.583515 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7dc92-1a51-4e51-b9e4-314d69c3c661 None admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:19.583794 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7dc92-1a51-4e51-b9e4-314d69c3c661 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:19.584099 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7dc92-1a51-4e51-b9e4-314d69c3c661 None admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:19.584795 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7dc92-1a51-4e51-b9e4-314d69c3c661 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:19.586281 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7dc92-1a51-4e51-b9e4-314d69c3c661 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:19.663729 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d375f-9b72-400e-af3d-dce034facee2 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:19.695202 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c4dfe-80c6-49d8-97ff-c561ee176a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:19.696023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c4dfe-80c6-49d8-97ff-c561ee176a4a None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:19.696339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c4dfe-80c6-49d8-97ff-c561ee176a4a None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:19.696868 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c4dfe-80c6-49d8-97ff-c561ee176a4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:19.707493 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c4dfe-80c6-49d8-97ff-c561ee176a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:19.708980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c4dfe-80c6-49d8-97ff-c561ee176a4a None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:19.720332 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 229/466] 10.222.0.18 () {60 vars in 1132 bytes} [Mon May 2 08:44:19 2022] POST /identity/v3/users => generated 246 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:44:19.721721 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20185b09-ccca-45d0-a64f-884fdbd9b894 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:19.722099 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20185b09-ccca-45d0-a64f-884fdbd9b894 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:19.722450 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20185b09-ccca-45d0-a64f-884fdbd9b894 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:19.728303 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 230/467] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:19.728303 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20185b09-ccca-45d0-a64f-884fdbd9b894 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:19.728568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-e74c4dfe-80c6-49d8-97ff-c561ee176a4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:19.728568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:19.728568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:19.728568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:19.728568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:19.728568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:19.728568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:19.728568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:19.728568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:19.728568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:19.728568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:19.728568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:19.728568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:19.728568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:19.728568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:19.729337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:19.729337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:19.729337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:19.729337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:19.729337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:19.729337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:19.729337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:19.729337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:19.729337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:19.729337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:19.729337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:19.729337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:19.729337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:19.729337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:19.729337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:19.729337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:19.729337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:19.730162 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:19.730162 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:19.730162 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:19.730162 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:19.730162 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 238/468] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:19.734225 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b71f-ef87-422d-888e-04aad72d78d5 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:19.734514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b71f-ef87-422d-888e-04aad72d78d5 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:19.734793 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b71f-ef87-422d-888e-04aad72d78d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:19.753298 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-57e6b71f-ef87-422d-888e-04aad72d78d5 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:19.754511 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-57e6b71f-ef87-422d-888e-04aad72d78d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:19.839444 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 239/469] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:19.839444 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6b71f-ef87-422d-888e-04aad72d78d5 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:19.854625 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20185b09-ccca-45d0-a64f-884fdbd9b894 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:19.895593 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b7c75-914d-4a47-a4e1-056ce3cb18fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:19.896690 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b7c75-914d-4a47-a4e1-056ce3cb18fa None admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:19.897120 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b7c75-914d-4a47-a4e1-056ce3cb18fa None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:19.897677 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b7c75-914d-4a47-a4e1-056ce3cb18fa None admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:19.898932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b7c75-914d-4a47-a4e1-056ce3cb18fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:19.901000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b7c75-914d-4a47-a4e1-056ce3cb18fa None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:19.953572 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6b71f-ef87-422d-888e-04aad72d78d5 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:19.986967 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef393d0f-98a7-4e79-800f-06eaac0cd2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:19.987625 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef393d0f-98a7-4e79-800f-06eaac0cd2e1 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:19.987904 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef393d0f-98a7-4e79-800f-06eaac0cd2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:19.988216 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef393d0f-98a7-4e79-800f-06eaac0cd2e1 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:19.992431 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 231/470] 10.222.0.18 () {60 vars in 1132 bytes} [Mon May 2 08:44:19 2022] POST /identity/v3/users => generated 248 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:44:19.992925 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef393d0f-98a7-4e79-800f-06eaac0cd2e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:19.992925 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef393d0f-98a7-4e79-800f-06eaac0cd2e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:19.993076 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b7c75-914d-4a47-a4e1-056ce3cb18fa None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:19.993146 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef393d0f-98a7-4e79-800f-06eaac0cd2e1 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:20.003543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 240/471] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:20.009262 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef393d0f-98a7-4e79-800f-06eaac0cd2e1 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:20.103974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b7c75-914d-4a47-a4e1-056ce3cb18fa None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:20.116852 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef393d0f-98a7-4e79-800f-06eaac0cd2e1 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:20.140774 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1532331-0fbb-47f5-bbe2-3d59011354cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:20.141598 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1532331-0fbb-47f5-bbe2-3d59011354cf None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:20.141881 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1532331-0fbb-47f5-bbe2-3d59011354cf None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:20.142155 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1532331-0fbb-47f5-bbe2-3d59011354cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:20.153184 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea17f08-c829-4ad2-b752-f4baa20d38ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:20.153860 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea17f08-c829-4ad2-b752-f4baa20d38ba None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:20.154040 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1532331-0fbb-47f5-bbe2-3d59011354cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:20.154134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea17f08-c829-4ad2-b752-f4baa20d38ba None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:20.154596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea17f08-c829-4ad2-b752-f4baa20d38ba None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:20.155513 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea17f08-c829-4ad2-b752-f4baa20d38ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:20.155708 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1532331-0fbb-47f5-bbe2-3d59011354cf None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:20.157035 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea17f08-c829-4ad2-b752-f4baa20d38ba None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:20.174773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-b1532331-0fbb-47f5-bbe2-3d59011354cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:20.174773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:20.174773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:20.174773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:20.174773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:20.174773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:20.174773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:20.174773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:20.174773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:20.174773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:20.174773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:20.174773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:20.174773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:20.174773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:20.174773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:20.180403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:20.180403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:20.180403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:20.180403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:20.180403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:20.180403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:20.180403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:20.180403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:20.180403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:20.180403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:20.180403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:20.180403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:20.180403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:20.180403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:20.180403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:20.180403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:20.180403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:20.181608 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:20.181608 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:20.181608 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:20.181608 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:20.181608 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 232/472] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:20.183774 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1532331-0fbb-47f5-bbe2-3d59011354cf None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:20.268265 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 241/473] 10.222.0.18 () {60 vars in 1132 bytes} [Mon May 2 08:44:20 2022] POST /identity/v3/users => generated 248 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:44:20.286477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1532331-0fbb-47f5-bbe2-3d59011354cf None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:20.326978 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98e2f5-c1e6-4839-a0a1-0f7601d71faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:20.328025 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98e2f5-c1e6-4839-a0a1-0f7601d71faf None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:20.328565 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98e2f5-c1e6-4839-a0a1-0f7601d71faf None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:20.329038 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98e2f5-c1e6-4839-a0a1-0f7601d71faf None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:20.330091 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98e2f5-c1e6-4839-a0a1-0f7601d71faf None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:20.330624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98e2f5-c1e6-4839-a0a1-0f7601d71faf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:20.332358 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98e2f5-c1e6-4839-a0a1-0f7601d71faf None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:20.346764 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 233/474] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:20.352433 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea17f08-c829-4ad2-b752-f4baa20d38ba None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:20.462612 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea17f08-c829-4ad2-b752-f4baa20d38ba None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:20.502903 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e68a9a-b878-4365-8ba9-ac4e2b9405b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:20.503571 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e68a9a-b878-4365-8ba9-ac4e2b9405b4 None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:20.503848 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e68a9a-b878-4365-8ba9-ac4e2b9405b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:20.504154 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e68a9a-b878-4365-8ba9-ac4e2b9405b4 None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:20.504866 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e68a9a-b878-4365-8ba9-ac4e2b9405b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:20.506295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e68a9a-b878-4365-8ba9-ac4e2b9405b4 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:20.585534 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 242/475] 10.222.0.18 () {60 vars in 1132 bytes} [Mon May 2 08:44:20 2022] POST /identity/v3/users => generated 249 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:44:22.216038 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839cea2-1817-4f8f-9492-5d3d72498c6b None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:22.216607 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839cea2-1817-4f8f-9492-5d3d72498c6b None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:22.216607 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839cea2-1817-4f8f-9492-5d3d72498c6b None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:22.218800 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 234/476] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:22.225527 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45018090-b5de-40ce-86f0-92e3240f463a None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:22.225978 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45018090-b5de-40ce-86f0-92e3240f463a None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:22.226088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45018090-b5de-40ce-86f0-92e3240f463a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:22.245559 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-45018090-b5de-40ce-86f0-92e3240f463a None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:22.247137 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-45018090-b5de-40ce-86f0-92e3240f463a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:22.346290 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 243/477] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:22.371649 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839cea2-1817-4f8f-9492-5d3d72498c6b None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:22.479003 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839cea2-1817-4f8f-9492-5d3d72498c6b None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:22.516137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e68707-a430-4b01-8dc0-90adbc8bf33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:22.517611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e68707-a430-4b01-8dc0-90adbc8bf33b None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:22.518105 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e68707-a430-4b01-8dc0-90adbc8bf33b None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:22.518579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e68707-a430-4b01-8dc0-90adbc8bf33b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:22.521665 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6562126-6b44-415d-91e7-4356b479c759 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:22.521943 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6562126-6b44-415d-91e7-4356b479c759 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:22.522217 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6562126-6b44-415d-91e7-4356b479c759 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:22.523839 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 244/478] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:22.529176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f02278-6fcb-42e9-82a7-bbd0b933ae4c None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:22.529728 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f02278-6fcb-42e9-82a7-bbd0b933ae4c None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:22.530013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f02278-6fcb-42e9-82a7-bbd0b933ae4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:22.531729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e68707-a430-4b01-8dc0-90adbc8bf33b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:22.540874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-a6e68707-a430-4b01-8dc0-90adbc8bf33b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:22.540874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:22.540874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:22.540874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:22.540874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:22.540874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:22.540874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:22.540874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:22.540874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:22.540874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:22.540874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:22.540874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:22.540874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:22.540874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:22.540874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:22.540874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:22.541814 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:22.541814 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:22.541814 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:22.541814 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:22.541814 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:22.541814 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:22.541814 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:22.541814 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:22.541814 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:22.541814 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:22.541814 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:22.541814 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:22.541814 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:22.541814 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:22.541814 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:22.541814 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:22.542601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:22.542601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:22.542601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:22.542601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:22.542601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:22.542601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:22.542601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:22.542601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:22.542601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:22.542601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:22.542601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:22.542601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:22.545537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 235/479] 10.222.0.18 () {56 vars in 1102 bytes} [Mon May 2 08:44:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:22.551803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e68707-a430-4b01-8dc0-90adbc8bf33b None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:22.562360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-c8f02278-6fcb-42e9-82a7-bbd0b933ae4c None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:22.563476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-c8f02278-6fcb-42e9-82a7-bbd0b933ae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:22.677093 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e68707-a430-4b01-8dc0-90adbc8bf33b None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:22.724018 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccc07f-0695-4ce4-82de-cb516aeafd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:22.724898 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 245/480] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:44:22.725554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccc07f-0695-4ce4-82de-cb516aeafd94 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:22.725974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccc07f-0695-4ce4-82de-cb516aeafd94 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:22.726407 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccc07f-0695-4ce4-82de-cb516aeafd94 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:22.727290 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccc07f-0695-4ce4-82de-cb516aeafd94 None admin] RBAC: Adding query filter params (name=service) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:22.727729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccc07f-0695-4ce4-82de-cb516aeafd94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:22.729357 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccc07f-0695-4ce4-82de-cb516aeafd94 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:22.738822 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 236/481] 10.222.0.18 () {56 vars in 1103 bytes} [Mon May 2 08:44:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:22.744488 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f02278-6fcb-42e9-82a7-bbd0b933ae4c None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:22.753253 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccc07f-0695-4ce4-82de-cb516aeafd94 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:22.861401 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f02278-6fcb-42e9-82a7-bbd0b933ae4c None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:22.868073 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccc07f-0695-4ce4-82de-cb516aeafd94 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:22.897634 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7ff67-5da5-4119-8ba1-b11d528bec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:22.898421 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7ff67-5da5-4119-8ba1-b11d528bec2b None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:22.898701 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7ff67-5da5-4119-8ba1-b11d528bec2b None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:22.898972 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7ff67-5da5-4119-8ba1-b11d528bec2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:22.900661 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ede74e-fc3e-4448-9f07-e240703accc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:22.901460 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ede74e-fc3e-4448-9f07-e240703accc1 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:22.901747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ede74e-fc3e-4448-9f07-e240703accc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:22.902027 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ede74e-fc3e-4448-9f07-e240703accc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:22.909675 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7ff67-5da5-4119-8ba1-b11d528bec2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:22.912735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ede74e-fc3e-4448-9f07-e240703accc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:22.913192 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7ff67-5da5-4119-8ba1-b11d528bec2b None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:22.921119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-46ede74e-fc3e-4448-9f07-e240703accc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:22.921119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:22.921119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:22.921119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:22.921119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:22.921119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:22.921119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:22.921119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:22.921119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:22.921119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:22.921119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:22.921119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:22.921119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:22.921119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:22.921119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:22.921119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:22.922045 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:22.922045 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:22.922045 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:22.922045 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:22.922045 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:22.922045 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:22.922045 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:22.922045 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:22.922045 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:22.922045 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:22.922045 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:22.922045 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:22.922045 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:22.922045 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:22.922045 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:22.922045 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:22.922932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:22.922932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:22.922932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:22.922932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:22.922932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:22.922932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:22.922932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:22.922932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:22.922932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:22.922932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:22.922932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:22.922932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:22.922932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 237/482] 10.222.0.18 () {56 vars in 1102 bytes} [Mon May 2 08:44:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:22.923588 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9272e82-0500-4366-aeed-5b7e19e7d0be None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:22.924200 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9272e82-0500-4366-aeed-5b7e19e7d0be None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:22.924200 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9272e82-0500-4366-aeed-5b7e19e7d0be None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:22.925415 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 238/483] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:22.928881 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9272e82-0500-4366-aeed-5b7e19e7d0be None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:22.936149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-1ac7ff67-5da5-4119-8ba1-b11d528bec2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:22.936149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:22.936149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:22.936149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:22.936149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:22.936149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:22.936149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:22.936149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:22.936149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:22.936149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:22.936149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:22.936149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:22.936149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:22.936149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:22.936149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:22.937024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:22.937024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:22.937024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:22.937024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:22.937024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:22.937024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:22.937024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:22.937024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:22.937024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:22.937024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:22.937024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:22.937024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:22.937024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:22.937024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:22.937024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:22.937024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:22.937024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:22.937856 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:22.937856 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:22.937856 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:22.937856 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:22.937856 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 246/484] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:22.938944 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c673620-4aa3-4507-8e15-985b2c1030f7 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:22.939382 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c673620-4aa3-4507-8e15-985b2c1030f7 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:22.939799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c673620-4aa3-4507-8e15-985b2c1030f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:22.957614 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-8c673620-4aa3-4507-8e15-985b2c1030f7 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:22.958938 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-8c673620-4aa3-4507-8e15-985b2c1030f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:23.023536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 247/485] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:23.024319 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c673620-4aa3-4507-8e15-985b2c1030f7 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:23.038340 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9272e82-0500-4366-aeed-5b7e19e7d0be None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:23.070634 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a0139-5dce-4355-8221-fef9063c96a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:23.071292 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a0139-5dce-4355-8221-fef9063c96a9 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:23.071823 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a0139-5dce-4355-8221-fef9063c96a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:23.072127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a0139-5dce-4355-8221-fef9063c96a9 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:23.072860 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a0139-5dce-4355-8221-fef9063c96a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:23.073163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a0139-5dce-4355-8221-fef9063c96a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:23.074556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a0139-5dce-4355-8221-fef9063c96a9 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:23.082562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 239/486] 10.222.0.18 () {56 vars in 1103 bytes} [Mon May 2 08:44:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:23.083825 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc6d0f-6b35-4a3e-a490-644de28245f8 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:23.084137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc6d0f-6b35-4a3e-a490-644de28245f8 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:23.084413 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc6d0f-6b35-4a3e-a490-644de28245f8 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:23.085766 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 240/487] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:23.088871 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc6d0f-6b35-4a3e-a490-644de28245f8 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:23.119345 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c673620-4aa3-4507-8e15-985b2c1030f7 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:23.151107 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c018f-2635-478f-8781-70975cc287c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:23.151837 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c018f-2635-478f-8781-70975cc287c2 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:23.152151 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c018f-2635-478f-8781-70975cc287c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:23.152426 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c018f-2635-478f-8781-70975cc287c2 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:23.153135 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c018f-2635-478f-8781-70975cc287c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:23.153437 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c018f-2635-478f-8781-70975cc287c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:23.155409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c018f-2635-478f-8781-70975cc287c2 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:23.165940 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 248/488] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:23.166793 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c018f-2635-478f-8781-70975cc287c2 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:23.185245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc6d0f-6b35-4a3e-a490-644de28245f8 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:23.217597 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee0f1e-7adb-4f15-84c6-2bd05cb423ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:23.218390 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee0f1e-7adb-4f15-84c6-2bd05cb423ce None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:23.218667 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee0f1e-7adb-4f15-84c6-2bd05cb423ce None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:23.218937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee0f1e-7adb-4f15-84c6-2bd05cb423ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:23.228431 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee0f1e-7adb-4f15-84c6-2bd05cb423ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:23.236085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-ecee0f1e-7adb-4f15-84c6-2bd05cb423ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:23.236085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:23.236085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:23.236085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:23.236085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:23.236085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:23.236085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:23.236085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:23.236085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:23.236085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:23.236085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:23.236085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:23.236085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:23.236085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:23.236085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:23.236085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:23.237156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:23.237156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:23.237156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:23.237156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:23.237156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:23.237156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:23.237156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:23.237156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:23.237156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:23.237156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:23.237156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:23.237156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:23.237156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:23.237156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:23.237156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:23.237156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:23.237976 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:23.237976 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:23.237976 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:23.237976 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:23.237976 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:23.237976 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:23.237976 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:23.237976 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:23.237976 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:23.237976 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:23.237976 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:23.237976 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:23.237976 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 241/489] 10.222.0.18 () {56 vars in 1102 bytes} [Mon May 2 08:44:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:23.238631 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc0bdb-2672-499f-923f-b26eb5f21f08 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:23.238631 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc0bdb-2672-499f-923f-b26eb5f21f08 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:23.239137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc0bdb-2672-499f-923f-b26eb5f21f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:23.254367 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-d8bc0bdb-2672-499f-923f-b26eb5f21f08 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:23.255539 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-d8bc0bdb-2672-499f-923f-b26eb5f21f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:23.273183 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c018f-2635-478f-8781-70975cc287c2 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:23.306139 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfffcf-c92c-4ab6-9130-f084c43f9e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:23.306838 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfffcf-c92c-4ab6-9130-f084c43f9e44 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:23.307119 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfffcf-c92c-4ab6-9130-f084c43f9e44 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:23.307392 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfffcf-c92c-4ab6-9130-f084c43f9e44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:23.317250 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfffcf-c92c-4ab6-9130-f084c43f9e44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:23.317579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 242/490] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:23.318403 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc0bdb-2672-499f-923f-b26eb5f21f08 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:23.318991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfffcf-c92c-4ab6-9130-f084c43f9e44 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:23.339283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-b2dfffcf-c92c-4ab6-9130-f084c43f9e44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:23.339283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:23.339283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:23.339283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:23.339283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:23.339283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:23.339283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:23.339283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:23.339283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:23.339283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:23.339283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:23.339283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:23.339283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:23.339283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:23.339283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:23.340181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:23.340181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:23.340181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:23.340181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:23.340181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:23.340181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:23.340181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:23.340181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:23.340181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:23.340181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:23.340181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:23.340181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:23.340181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:23.340181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:23.340181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:23.340181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:23.340181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:23.341042 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:23.341042 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:23.341042 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:23.341042 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:23.341042 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 249/491] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:23.342779 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfffcf-c92c-4ab6-9130-f084c43f9e44 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:23.414778 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc0bdb-2672-499f-923f-b26eb5f21f08 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:23.435122 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfffcf-c92c-4ab6-9130-f084c43f9e44 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:23.448292 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180bc77-97d4-49a1-938f-0edc0e1be430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:23.449087 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180bc77-97d4-49a1-938f-0edc0e1be430 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:23.449373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180bc77-97d4-49a1-938f-0edc0e1be430 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:23.449646 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180bc77-97d4-49a1-938f-0edc0e1be430 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:23.457492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180bc77-97d4-49a1-938f-0edc0e1be430 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:23.458961 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180bc77-97d4-49a1-938f-0edc0e1be430 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:23.469091 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92566c7-d4dc-4af7-aa61-e3a77055631e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:23.469750 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92566c7-d4dc-4af7-aa61-e3a77055631e None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:23.470034 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92566c7-d4dc-4af7-aa61-e3a77055631e None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:23.470309 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92566c7-d4dc-4af7-aa61-e3a77055631e None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:23.471048 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92566c7-d4dc-4af7-aa61-e3a77055631e None admin] RBAC: Adding query filter params (name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:23.471383 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92566c7-d4dc-4af7-aa61-e3a77055631e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:23.472803 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92566c7-d4dc-4af7-aa61-e3a77055631e None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:23.475000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-1180bc77-97d4-49a1-938f-0edc0e1be430 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 02 08:44:23.475000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:23.475000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:23.475000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:23.475000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:23.475000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:23.475000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:23.475000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:23.475000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:23.475000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:23.475000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:23.475000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:23.475000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:44:23.475000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:44:23.475000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:44:23.475000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:44:23.475861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:23.475861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:23.475861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:44:23.475861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:23.475861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:44:23.475861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:23.475861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:23.475861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:23.475861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:23.475861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:23.475861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:23.475861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:23.475861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:23.475861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:23.475861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:23.475861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:23.475861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:23.475861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:23.476856 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:23.476856 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:23.476856 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:44:23.476856 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:44:23.476856 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:44:23.476856 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:44:23.476856 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:44:23.476856 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:44:23.476856 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 02 08:44:23.476856 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:23.476856 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 243/492] 10.222.0.18 () {56 vars in 1093 bytes} [Mon May 2 08:44:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:23.477446 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180bc77-97d4-49a1-938f-0edc0e1be430 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:23.484242 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 250/493] 10.222.0.18 () {56 vars in 1103 bytes} [Mon May 2 08:44:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:23.485049 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92566c7-d4dc-4af7-aa61-e3a77055631e None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:23.579775 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180bc77-97d4-49a1-938f-0edc0e1be430 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:23.579965 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92566c7-d4dc-4af7-aa61-e3a77055631e None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:23.610908 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16658dd-0095-49cf-a810-67def89c06a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:23.611597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16658dd-0095-49cf-a810-67def89c06a6 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:23.611707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0f2ef-a15a-4134-91e4-f2876d096e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:23.611885 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16658dd-0095-49cf-a810-67def89c06a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:23.612194 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16658dd-0095-49cf-a810-67def89c06a6 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:23.612533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0f2ef-a15a-4134-91e4-f2876d096e16 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:23.612819 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0f2ef-a15a-4134-91e4-f2876d096e16 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:23.612908 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16658dd-0095-49cf-a810-67def89c06a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:23.613097 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0f2ef-a15a-4134-91e4-f2876d096e16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:23.613190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16658dd-0095-49cf-a810-67def89c06a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:23.614552 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16658dd-0095-49cf-a810-67def89c06a6 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:23.622838 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0f2ef-a15a-4134-91e4-f2876d096e16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:23.626378 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 251/494] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:23.627165 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16658dd-0095-49cf-a810-67def89c06a6 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:23.631692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-9eb0f2ef-a15a-4134-91e4-f2876d096e16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:23.631692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:23.631692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:23.631692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:23.631692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:23.631692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:23.631692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:23.631692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:23.631692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:23.631692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:23.631692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:23.631692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:23.631692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:23.631692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:23.631692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:23.631692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:23.632614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:23.632614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:23.632614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:23.632614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:23.632614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:23.632614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:23.632614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:23.632614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:23.632614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:23.632614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:23.632614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:23.632614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:23.632614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:23.632614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:23.632614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:23.632614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:23.634267 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:23.634267 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:23.634267 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:23.634267 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:23.634267 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:23.634267 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:23.634267 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:23.634267 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:23.634267 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:23.634267 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:23.634267 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:23.634267 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:23.634267 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 244/495] 10.222.0.18 () {56 vars in 1102 bytes} [Mon May 2 08:44:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:23.634267 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0f2ef-a15a-4134-91e4-f2876d096e16 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:23.723247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16658dd-0095-49cf-a810-67def89c06a6 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:23.732071 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0f2ef-a15a-4134-91e4-f2876d096e16 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:23.756605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf64d56-4187-4a99-a249-c1d054b0556d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:23.757266 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf64d56-4187-4a99-a249-c1d054b0556d None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:23.757546 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf64d56-4187-4a99-a249-c1d054b0556d None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:23.757822 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf64d56-4187-4a99-a249-c1d054b0556d None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:23.758732 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf64d56-4187-4a99-a249-c1d054b0556d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:23.759039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf64d56-4187-4a99-a249-c1d054b0556d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:23.760550 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf64d56-4187-4a99-a249-c1d054b0556d None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:23.765225 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f538ab-873c-4c41-a69b-232ca2669c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:23.766017 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f538ab-873c-4c41-a69b-232ca2669c73 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:23.766298 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f538ab-873c-4c41-a69b-232ca2669c73 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:23.766572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f538ab-873c-4c41-a69b-232ca2669c73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:23.776661 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f538ab-873c-4c41-a69b-232ca2669c73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:23.779584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f538ab-873c-4c41-a69b-232ca2669c73 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:23.794532 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-78f538ab-873c-4c41-a69b-232ca2669c73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:23.794532 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:23.794532 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:23.794532 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:23.794532 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:23.794532 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:23.794532 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:23.794532 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:23.794532 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:23.794532 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:23.794532 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:23.794532 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:23.794532 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:23.794532 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:23.794532 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:23.795927 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:23.795927 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:23.795927 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:23.795927 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:23.795927 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:23.795927 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:23.795927 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:23.795927 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:23.795927 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:23.795927 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:23.795927 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:23.795927 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:23.795927 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:23.795927 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:23.795927 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:23.795927 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:23.795927 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:23.796914 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:23.796914 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:23.796914 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:23.796914 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:23.796914 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 245/496] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:23.797194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f538ab-873c-4c41-a69b-232ca2669c73 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:23.797848 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 252/497] 10.222.0.18 () {56 vars in 1133 bytes} [Mon May 2 08:44:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:23.798681 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf64d56-4187-4a99-a249-c1d054b0556d None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:23.896436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f538ab-873c-4c41-a69b-232ca2669c73 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:23.897199 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf64d56-4187-4a99-a249-c1d054b0556d None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:23.927992 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9eeb8-943c-48d3-9fe6-7c8cc698f1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:23.928813 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9eeb8-943c-48d3-9fe6-7c8cc698f1c5 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:23.929058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bea7d-fa44-4738-b0b0-36c3f7fcfc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:23.929166 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9eeb8-943c-48d3-9fe6-7c8cc698f1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:23.929357 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9eeb8-943c-48d3-9fe6-7c8cc698f1c5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:23.929817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bea7d-fa44-4738-b0b0-36c3f7fcfc64 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:23.930095 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bea7d-fa44-4738-b0b0-36c3f7fcfc64 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:23.930363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bea7d-fa44-4738-b0b0-36c3f7fcfc64 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:23.931096 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bea7d-fa44-4738-b0b0-36c3f7fcfc64 None admin] RBAC: Adding query filter params (name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:23.931396 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bea7d-fa44-4738-b0b0-36c3f7fcfc64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:23.932809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bea7d-fa44-4738-b0b0-36c3f7fcfc64 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:23.941021 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9eeb8-943c-48d3-9fe6-7c8cc698f1c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:23.941261 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 253/498] 10.222.0.18 () {56 vars in 1103 bytes} [Mon May 2 08:44:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:23.942052 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bea7d-fa44-4738-b0b0-36c3f7fcfc64 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:23.942494 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9eeb8-943c-48d3-9fe6-7c8cc698f1c5 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:23.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-b3f9eeb8-943c-48d3-9fe6-7c8cc698f1c5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 02 08:44:23.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:23.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:23.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:23.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:23.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:23.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:23.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:23.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:23.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:23.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:23.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:23.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:44:23.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:44:23.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:44:23.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:44:23.957939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:23.957939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:23.957939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:44:23.957939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:23.957939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:44:23.957939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:23.957939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:23.957939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:23.957939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:23.957939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:23.957939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:23.957939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:23.957939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:23.957939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:23.957939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:23.957939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:23.957939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:23.957939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:23.958860 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:23.958860 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:23.958860 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:44:23.958860 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:44:23.958860 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:44:23.958860 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:44:23.958860 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:44:23.958860 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:44:23.958860 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 02 08:44:23.958860 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:23.958860 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 246/499] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:23.958860 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9eeb8-943c-48d3-9fe6-7c8cc698f1c5 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:24.037334 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bea7d-fa44-4738-b0b0-36c3f7fcfc64 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:24.054119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9eeb8-943c-48d3-9fe6-7c8cc698f1c5 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:24.068951 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2284c7e-239f-4750-b89d-e27ae5225ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:24.069598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2284c7e-239f-4750-b89d-e27ae5225ab3 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:24.069878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2284c7e-239f-4750-b89d-e27ae5225ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:24.070159 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2284c7e-239f-4750-b89d-e27ae5225ab3 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:24.070860 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2284c7e-239f-4750-b89d-e27ae5225ab3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:24.071164 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2284c7e-239f-4750-b89d-e27ae5225ab3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:24.072822 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2284c7e-239f-4750-b89d-e27ae5225ab3 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:24.084178 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 254/500] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:24.084949 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2284c7e-239f-4750-b89d-e27ae5225ab3 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:24.086266 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6ac85-00a6-4e76-b80f-fa6f4ff2ec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:24.086914 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6ac85-00a6-4e76-b80f-fa6f4ff2ec0f None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:24.087262 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6ac85-00a6-4e76-b80f-fa6f4ff2ec0f None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:24.087469 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6ac85-00a6-4e76-b80f-fa6f4ff2ec0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:24.150651 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6ac85-00a6-4e76-b80f-fa6f4ff2ec0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:24.152139 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6ac85-00a6-4e76-b80f-fa6f4ff2ec0f None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:24.176617 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2284c7e-239f-4750-b89d-e27ae5225ab3 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:24.208312 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f68d1-1ca9-42c4-b6ce-895e96dee33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:24.209084 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f68d1-1ca9-42c4-b6ce-895e96dee33e None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:24.209363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f68d1-1ca9-42c4-b6ce-895e96dee33e None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:24.209633 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f68d1-1ca9-42c4-b6ce-895e96dee33e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:24.219516 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f68d1-1ca9-42c4-b6ce-895e96dee33e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:24.220977 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f68d1-1ca9-42c4-b6ce-895e96dee33e None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:24.238070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-452f68d1-1ca9-42c4-b6ce-895e96dee33e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:24.238070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:24.238070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:24.238070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:24.238070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:24.238070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:24.238070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:24.238070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:24.238070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:24.238070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:24.238070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:24.238070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:24.238070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:24.238070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:24.238070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:24.239065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:24.239065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:24.239065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:24.239065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:24.239065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:24.239065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:24.239065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:24.239065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:24.239065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:24.239065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:24.239065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:24.239065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:24.239065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:24.239065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:24.239065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:24.239065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:24.239065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:24.239923 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:24.239923 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:24.239923 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:24.239923 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:24.239923 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 255/501] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:24.240328 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f68d1-1ca9-42c4-b6ce-895e96dee33e None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:24.249039 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 247/502] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:44:24.249875 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6ac85-00a6-4e76-b80f-fa6f4ff2ec0f None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:24.333779 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f68d1-1ca9-42c4-b6ce-895e96dee33e None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:24.341307 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6ac85-00a6-4e76-b80f-fa6f4ff2ec0f None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:24.365933 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebacd47-0ee1-4d50-9359-43cbbd6a22a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:24.366590 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebacd47-0ee1-4d50-9359-43cbbd6a22a2 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:24.366871 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebacd47-0ee1-4d50-9359-43cbbd6a22a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:24.367145 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebacd47-0ee1-4d50-9359-43cbbd6a22a2 None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:24.367964 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebacd47-0ee1-4d50-9359-43cbbd6a22a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:24.368306 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebacd47-0ee1-4d50-9359-43cbbd6a22a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:24.369733 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebacd47-0ee1-4d50-9359-43cbbd6a22a2 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:24.373579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548382be-01bc-44e0-9142-477493b12bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:24.374356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548382be-01bc-44e0-9142-477493b12bf2 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:24.374634 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548382be-01bc-44e0-9142-477493b12bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:24.374906 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548382be-01bc-44e0-9142-477493b12bf2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:24.381618 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548382be-01bc-44e0-9142-477493b12bf2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:24.383047 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548382be-01bc-44e0-9142-477493b12bf2 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:24.386052 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 256/503] 10.222.0.18 () {56 vars in 1137 bytes} [Mon May 2 08:44:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:24.386850 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebacd47-0ee1-4d50-9359-43cbbd6a22a2 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:24.397349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-548382be-01bc-44e0-9142-477493b12bf2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 02 08:44:24.397349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:24.397349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:24.397349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:24.397349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:24.397349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:24.397349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:24.397349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:24.397349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:24.397349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:24.397349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:24.397349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:24.397349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:44:24.397349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:44:24.397349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:44:24.397349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:44:24.399178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:24.399178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:24.399178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:44:24.399178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:24.399178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:44:24.399178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:24.399178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:24.399178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:24.399178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:24.399178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:24.399178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:24.399178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:24.399178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:24.399178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:24.399178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:24.399178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:24.399178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:24.399178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:24.400108 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:24.400108 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:24.400108 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:44:24.400108 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:44:24.400108 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:44:24.400108 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:44:24.400108 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:44:24.400108 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:44:24.400108 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 02 08:44:24.400108 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:24.400631 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 248/504] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:24.401179 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548382be-01bc-44e0-9142-477493b12bf2 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:24.481273 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebacd47-0ee1-4d50-9359-43cbbd6a22a2 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:24.493099 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548382be-01bc-44e0-9142-477493b12bf2 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:24.514495 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8008b5b-585b-49e2-8a52-74e53aae6c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:24.514886 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8008b5b-585b-49e2-8a52-74e53aae6c2c None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:24.515190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8008b5b-585b-49e2-8a52-74e53aae6c2c None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:24.515471 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8008b5b-585b-49e2-8a52-74e53aae6c2c None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:24.516223 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8008b5b-585b-49e2-8a52-74e53aae6c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:24.516534 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8008b5b-585b-49e2-8a52-74e53aae6c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:24.517925 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8008b5b-585b-49e2-8a52-74e53aae6c2c None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:24.524613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd8204-ceb6-470a-9cce-eb26844ea865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:24.525396 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd8204-ceb6-470a-9cce-eb26844ea865 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:24.525679 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd8204-ceb6-470a-9cce-eb26844ea865 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:24.525956 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd8204-ceb6-470a-9cce-eb26844ea865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:24.528713 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 257/505] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:24.530363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8008b5b-585b-49e2-8a52-74e53aae6c2c None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:24.536420 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd8204-ceb6-470a-9cce-eb26844ea865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:24.537875 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd8204-ceb6-470a-9cce-eb26844ea865 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:24.554852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-87cd8204-ceb6-470a-9cce-eb26844ea865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:24.554852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:24.554852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:24.554852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:24.554852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:24.554852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:24.554852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:24.554852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:24.554852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:24.554852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:24.554852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:24.554852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:24.554852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:24.554852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:24.554852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:24.555931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:24.555931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:24.555931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:24.555931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:24.555931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:24.555931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:24.555931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:24.555931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:24.555931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:24.555931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:24.555931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:24.555931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:24.555931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:24.555931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:24.555931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:24.555931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:24.555931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:24.561826 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:24.561826 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:24.561826 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:24.561826 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:24.561826 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 249/506] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:24.561826 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd8204-ceb6-470a-9cce-eb26844ea865 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:24.627055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8008b5b-585b-49e2-8a52-74e53aae6c2c None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:24.652449 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd8204-ceb6-470a-9cce-eb26844ea865 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:24.660458 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a160f94-06c7-44bd-9161-32e9d7e826f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:24.661128 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a160f94-06c7-44bd-9161-32e9d7e826f6 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:24.661395 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a160f94-06c7-44bd-9161-32e9d7e826f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:24.661671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a160f94-06c7-44bd-9161-32e9d7e826f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:24.687424 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bdc6a-d998-4bf0-aa66-6a91e33a664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:24.688127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bdc6a-d998-4bf0-aa66-6a91e33a664e None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:24.688408 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bdc6a-d998-4bf0-aa66-6a91e33a664e None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:24.688678 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bdc6a-d998-4bf0-aa66-6a91e33a664e None admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:24.689496 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bdc6a-d998-4bf0-aa66-6a91e33a664e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:24.689803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bdc6a-d998-4bf0-aa66-6a91e33a664e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:24.691239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bdc6a-d998-4bf0-aa66-6a91e33a664e None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:24.726639 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a160f94-06c7-44bd-9161-32e9d7e826f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:24.728129 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a160f94-06c7-44bd-9161-32e9d7e826f6 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:24.729041 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 250/507] 10.222.0.18 () {56 vars in 1137 bytes} [Mon May 2 08:44:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:24.729865 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bdc6a-d998-4bf0-aa66-6a91e33a664e None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:24.820165 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 258/508] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:44:24.820916 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a160f94-06c7-44bd-9161-32e9d7e826f6 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:24.823501 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bdc6a-d998-4bf0-aa66-6a91e33a664e None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:24.856758 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e6f1a-a74c-4949-b419-b8a693bba5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:24.858212 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e6f1a-a74c-4949-b419-b8a693bba5ca None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:24.858595 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e6f1a-a74c-4949-b419-b8a693bba5ca None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:24.858970 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e6f1a-a74c-4949-b419-b8a693bba5ca None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:24.866660 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e6f1a-a74c-4949-b419-b8a693bba5ca None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:24.868165 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e6f1a-a74c-4949-b419-b8a693bba5ca None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:24.883265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-be8e6f1a-a74c-4949-b419-b8a693bba5ca None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 02 08:44:24.883265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:24.883265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:24.883265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:24.883265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:24.883265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:24.883265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:24.883265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:24.883265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:24.883265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:24.883265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:24.883265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:24.883265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:44:24.883265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:44:24.883265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:44:24.883265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:44:24.884258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:24.884258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:24.884258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:44:24.884258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:24.884258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:44:24.884258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:24.884258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:24.884258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:24.884258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:24.884258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:24.884258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:24.884258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:24.884258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:24.884258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:24.884258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:24.884258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:24.884258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:24.884258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:24.885148 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:24.885148 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:24.885148 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:44:24.885148 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:44:24.885148 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:44:24.885148 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:44:24.885148 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:44:24.885148 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:44:24.885148 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 02 08:44:24.885148 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:24.885148 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 251/509] 10.222.0.18 () {56 vars in 1102 bytes} [Mon May 2 08:44:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:24.885713 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e6f1a-a74c-4949-b419-b8a693bba5ca None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:24.916838 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a160f94-06c7-44bd-9161-32e9d7e826f6 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:24.948994 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e84a00-f0ad-46bd-a808-c13293874377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:24.949642 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e84a00-f0ad-46bd-a808-c13293874377 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:24.949923 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e84a00-f0ad-46bd-a808-c13293874377 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:24.950198 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e84a00-f0ad-46bd-a808-c13293874377 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:24.950906 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e84a00-f0ad-46bd-a808-c13293874377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:24.951264 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e84a00-f0ad-46bd-a808-c13293874377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:24.953555 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e84a00-f0ad-46bd-a808-c13293874377 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:24.964257 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 259/510] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:24.965038 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e84a00-f0ad-46bd-a808-c13293874377 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:24.985428 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e6f1a-a74c-4949-b419-b8a693bba5ca None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:25.016861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d6669-277f-457e-81aa-8456e32295bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:25.017507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d6669-277f-457e-81aa-8456e32295bd None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:25.017795 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d6669-277f-457e-81aa-8456e32295bd None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:25.018072 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d6669-277f-457e-81aa-8456e32295bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:25.058007 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e84a00-f0ad-46bd-a808-c13293874377 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:25.081412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d6669-277f-457e-81aa-8456e32295bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:25.082862 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d6669-277f-457e-81aa-8456e32295bd None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:25.089246 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4574243-076b-43b7-a8a1-a8bf275f7d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:25.090024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4574243-076b-43b7-a8a1-a8bf275f7d97 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:25.090303 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4574243-076b-43b7-a8a1-a8bf275f7d97 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:25.090574 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4574243-076b-43b7-a8a1-a8bf275f7d97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:25.101117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4574243-076b-43b7-a8a1-a8bf275f7d97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:25.102555 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4574243-076b-43b7-a8a1-a8bf275f7d97 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:25.119464 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-d4574243-076b-43b7-a8a1-a8bf275f7d97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:25.119464 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:25.119464 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:25.119464 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:25.119464 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:25.119464 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:25.119464 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:25.119464 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:25.119464 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:25.119464 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:25.119464 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:25.119464 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:25.119464 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:25.119464 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:25.119464 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:25.120528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:25.120528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:25.120528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:25.120528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:25.120528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:25.120528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:25.120528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:25.120528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:25.120528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:25.120528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:25.120528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:25.120528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:25.120528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:25.120528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:25.120528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:25.120528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:25.120528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:25.121381 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:25.121381 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:25.121381 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:25.121381 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:25.121381 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 260/511] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:25.121381 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4574243-076b-43b7-a8a1-a8bf275f7d97 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:25.175758 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 252/512] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:44:25.176386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d6669-277f-457e-81aa-8456e32295bd None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:25.217819 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4574243-076b-43b7-a8a1-a8bf275f7d97 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:25.249013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a4d42-d41f-4e76-bb50-a3502ba1c749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:25.249666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a4d42-d41f-4e76-bb50-a3502ba1c749 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:25.249946 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a4d42-d41f-4e76-bb50-a3502ba1c749 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:25.250221 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a4d42-d41f-4e76-bb50-a3502ba1c749 None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:25.251026 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a4d42-d41f-4e76-bb50-a3502ba1c749 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:25.251329 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a4d42-d41f-4e76-bb50-a3502ba1c749 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:25.252787 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a4d42-d41f-4e76-bb50-a3502ba1c749 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:25.268559 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d6669-277f-457e-81aa-8456e32295bd None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:25.269997 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 261/513] 10.222.0.18 () {56 vars in 1139 bytes} [Mon May 2 08:44:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:25.270787 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a4d42-d41f-4e76-bb50-a3502ba1c749 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:25.300703 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccadf0-81da-450f-bbeb-41db9db8af92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:25.301491 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccadf0-81da-450f-bbeb-41db9db8af92 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:25.301778 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccadf0-81da-450f-bbeb-41db9db8af92 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:25.302047 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccadf0-81da-450f-bbeb-41db9db8af92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:25.308334 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccadf0-81da-450f-bbeb-41db9db8af92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:25.309786 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccadf0-81da-450f-bbeb-41db9db8af92 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:25.323713 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-b2ccadf0-81da-450f-bbeb-41db9db8af92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:25.323713 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:25.323713 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:25.323713 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:25.323713 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:25.323713 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:25.323713 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:25.323713 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:25.323713 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:25.323713 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:25.323713 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:25.323713 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:25.323713 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:44:25.323713 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:44:25.323713 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:44:25.324596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:44:25.324596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:25.324596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:25.324596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:25.324596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:25.324596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:25.324596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:25.324596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:25.324596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:25.324596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:25.324596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:25.324596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:25.324596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:25.324596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:25.324596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:25.324596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:25.324596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:25.325450 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:44:25.325450 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:44:25.325450 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:44:25.325450 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:44:25.325450 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:44:25.325450 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:44:25.325450 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:25.325450 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:25.325450 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 253/514] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:25.326972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccadf0-81da-450f-bbeb-41db9db8af92 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:25.364232 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a4d42-d41f-4e76-bb50-a3502ba1c749 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:25.395763 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f31829-7d44-4b55-9519-afd4a49fb29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:25.396434 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f31829-7d44-4b55-9519-afd4a49fb29d None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:25.396710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f31829-7d44-4b55-9519-afd4a49fb29d None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:25.403340 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f31829-7d44-4b55-9519-afd4a49fb29d None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:25.403340 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f31829-7d44-4b55-9519-afd4a49fb29d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:25.403340 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f31829-7d44-4b55-9519-afd4a49fb29d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:25.403340 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f31829-7d44-4b55-9519-afd4a49fb29d None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:25.410608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 262/515] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:25.411394 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f31829-7d44-4b55-9519-afd4a49fb29d None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:25.421539 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccadf0-81da-450f-bbeb-41db9db8af92 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:25.454820 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ffccb-a0db-42e2-ad53-e48143f3e04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:25.455534 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ffccb-a0db-42e2-ad53-e48143f3e04a None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:25.455884 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ffccb-a0db-42e2-ad53-e48143f3e04a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:25.456189 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ffccb-a0db-42e2-ad53-e48143f3e04a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:25.465824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ffccb-a0db-42e2-ad53-e48143f3e04a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:25.467989 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ffccb-a0db-42e2-ad53-e48143f3e04a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:25.484993 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-978ffccb-a0db-42e2-ad53-e48143f3e04a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:25.484993 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:25.484993 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:25.484993 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:25.484993 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:25.484993 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:25.484993 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:25.484993 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:25.484993 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:25.484993 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:25.484993 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:25.484993 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:25.484993 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:25.484993 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:25.484993 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:25.485845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:25.485845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:25.485845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:25.485845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:25.485845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:25.485845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:25.485845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:25.485845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:25.485845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:25.485845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:25.485845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:25.485845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:25.485845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:25.485845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:25.485845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:25.485845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:25.485845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:25.486690 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:25.486690 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:25.486690 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:25.486690 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:25.486690 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 254/516] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:25.487524 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ffccb-a0db-42e2-ad53-e48143f3e04a None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:25.507808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f31829-7d44-4b55-9519-afd4a49fb29d None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:25.540351 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777772b-34e5-4673-940e-f648ee0b9ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:25.540986 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777772b-34e5-4673-940e-f648ee0b9ca1 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:25.541262 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777772b-34e5-4673-940e-f648ee0b9ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:25.541536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777772b-34e5-4673-940e-f648ee0b9ca1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:25.581425 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ffccb-a0db-42e2-ad53-e48143f3e04a None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:25.605026 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777772b-34e5-4673-940e-f648ee0b9ca1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:25.606475 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777772b-34e5-4673-940e-f648ee0b9ca1 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:25.613154 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb0c37-c248-4785-807f-99f252f4423f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:25.613813 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb0c37-c248-4785-807f-99f252f4423f None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:25.614092 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb0c37-c248-4785-807f-99f252f4423f None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:25.614361 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb0c37-c248-4785-807f-99f252f4423f None admin] PATH_INFO: `/v3/projects` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:25.615132 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb0c37-c248-4785-807f-99f252f4423f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:25.615439 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb0c37-c248-4785-807f-99f252f4423f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:25.616884 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb0c37-c248-4785-807f-99f252f4423f None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:25.634128 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 255/517] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:44:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:25.636966 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb0c37-c248-4785-807f-99f252f4423f None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:25.702138 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 263/518] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:44:25.702985 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777772b-34e5-4673-940e-f648ee0b9ca1 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:25.733702 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb0c37-c248-4785-807f-99f252f4423f None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:25.765845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16df62c-2e2d-4b0a-99ce-9493cc78ace7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:25.766628 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16df62c-2e2d-4b0a-99ce-9493cc78ace7 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:25.766908 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16df62c-2e2d-4b0a-99ce-9493cc78ace7 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:25.767175 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16df62c-2e2d-4b0a-99ce-9493cc78ace7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:25.773525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16df62c-2e2d-4b0a-99ce-9493cc78ace7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:25.774992 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16df62c-2e2d-4b0a-99ce-9493cc78ace7 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:25.788223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-e16df62c-2e2d-4b0a-99ce-9493cc78ace7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:25.788223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:25.788223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:25.788223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:25.788223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:25.788223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:25.788223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:25.788223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:25.788223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:25.788223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:25.788223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:25.788223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:25.788223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:44:25.788223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:44:25.788223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:44:25.789137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:44:25.789137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:25.789137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:25.789137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:25.789137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:25.789137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:25.789137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:25.789137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:25.789137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:25.789137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:25.789137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:25.789137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:25.789137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:25.789137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:25.789137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:25.789137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:25.789137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:25.790020 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:44:25.790020 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:44:25.790020 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:44:25.790020 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:44:25.790020 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:44:25.790020 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:44:25.790020 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:25.790020 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:25.790020 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 256/519] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:25.790473 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16df62c-2e2d-4b0a-99ce-9493cc78ace7 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:25.796516 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777772b-34e5-4673-940e-f648ee0b9ca1 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:25.830321 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b9fad-75a4-40d8-9d66-3d5ae93bd14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:25.830985 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b9fad-75a4-40d8-9d66-3d5ae93bd14e None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:25.831270 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b9fad-75a4-40d8-9d66-3d5ae93bd14e None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:25.831552 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b9fad-75a4-40d8-9d66-3d5ae93bd14e None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:25.832297 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b9fad-75a4-40d8-9d66-3d5ae93bd14e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:25.832606 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b9fad-75a4-40d8-9d66-3d5ae93bd14e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:25.833979 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b9fad-75a4-40d8-9d66-3d5ae93bd14e None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:25.844849 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 264/520] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:25.845668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b9fad-75a4-40d8-9d66-3d5ae93bd14e None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:25.892991 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16df62c-2e2d-4b0a-99ce-9493cc78ace7 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:25.924938 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044a62d-de07-4943-84e3-2f22df019bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:25.925580 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044a62d-de07-4943-84e3-2f22df019bab None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:25.925859 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044a62d-de07-4943-84e3-2f22df019bab None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:25.926128 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044a62d-de07-4943-84e3-2f22df019bab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:25.926934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044a62d-de07-4943-84e3-2f22df019bab None admin] RBAC: Adding query filter params (role.id=78258bf52d1f4340bb3f7eda6a73f71a, scope.project.id=758931ec3ed54a1eadf1b9a463fbb241, user.id=97308967556844019594cd0c4abc41fc) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:25.927253 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044a62d-de07-4943-84e3-2f22df019bab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:25.928719 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044a62d-de07-4943-84e3-2f22df019bab None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:25.934016 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 257/521] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:44:25 2022] GET /identity/v3/role_assignments?user.id=97308967556844019594cd0c4abc41fc&scope.project.id=758931ec3ed54a1eadf1b9a463fbb241&role.id=78258bf52d1f4340bb3f7eda6a73f71a => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:25.934615 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044a62d-de07-4943-84e3-2f22df019bab None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:25.939812 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b9fad-75a4-40d8-9d66-3d5ae93bd14e None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:25.978161 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d0d19-86f5-4282-a91f-0351bc4bd35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:25.978975 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d0d19-86f5-4282-a91f-0351bc4bd35f None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:25.979260 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d0d19-86f5-4282-a91f-0351bc4bd35f None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:25.979543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d0d19-86f5-4282-a91f-0351bc4bd35f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:25.992551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d0d19-86f5-4282-a91f-0351bc4bd35f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:25.993983 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d0d19-86f5-4282-a91f-0351bc4bd35f None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:26.012248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-e91d0d19-86f5-4282-a91f-0351bc4bd35f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:26.012248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:26.012248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:26.012248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:26.012248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:26.012248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:26.012248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:26.012248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:26.012248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:26.012248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:26.012248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:26.012248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:26.012248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:26.012248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:26.012248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:26.013169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:26.013169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:26.013169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:26.013169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:26.013169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:26.013169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:26.013169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:26.013169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:26.013169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:26.013169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:26.013169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:26.013169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:26.013169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:26.013169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:26.013169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:26.013169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:26.013169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:26.014919 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:26.014919 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:26.014919 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:26.014919 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:26.016594 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 265/522] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:26.017601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d0d19-86f5-4282-a91f-0351bc4bd35f None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:26.048514 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044a62d-de07-4943-84e3-2f22df019bab None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:26.084294 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471ec11-7adc-4966-824f-c6e74ba1a3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:26.085224 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471ec11-7adc-4966-824f-c6e74ba1a3fc None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:26.085653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471ec11-7adc-4966-824f-c6e74ba1a3fc None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:26.086097 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471ec11-7adc-4966-824f-c6e74ba1a3fc None admin] PATH_INFO: `/v3/projects` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:26.087027 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471ec11-7adc-4966-824f-c6e74ba1a3fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:26.087495 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471ec11-7adc-4966-824f-c6e74ba1a3fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:26.089165 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471ec11-7adc-4966-824f-c6e74ba1a3fc None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:26.102138 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 258/523] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:44:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:26.105036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471ec11-7adc-4966-824f-c6e74ba1a3fc None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:26.124520 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d0d19-86f5-4282-a91f-0351bc4bd35f None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:26.157941 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25e022-dc84-46a2-86ce-9acb56976634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:26.158729 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25e022-dc84-46a2-86ce-9acb56976634 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:26.159017 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25e022-dc84-46a2-86ce-9acb56976634 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:26.159291 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25e022-dc84-46a2-86ce-9acb56976634 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:26.166212 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25e022-dc84-46a2-86ce-9acb56976634 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:26.167644 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25e022-dc84-46a2-86ce-9acb56976634 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:26.183579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-ea25e022-dc84-46a2-86ce-9acb56976634 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:26.183579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:26.183579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:26.183579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:26.183579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:26.183579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:26.183579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:26.183579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:26.183579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:26.183579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:26.183579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:26.183579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:26.183579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:44:26.183579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:44:26.183579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:44:26.184717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:44:26.184717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:26.184717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:26.184717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:26.184717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:26.184717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:26.184717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:26.184717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:26.184717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:26.184717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:26.184717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:26.184717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:26.184717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:26.184717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:26.184717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:26.184717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:26.184717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:26.186150 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:44:26.186150 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:44:26.186150 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:44:26.186150 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:44:26.186150 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:44:26.186150 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:44:26.186150 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:26.186150 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:26.186150 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 266/524] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:26.187150 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25e022-dc84-46a2-86ce-9acb56976634 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:26.210545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471ec11-7adc-4966-824f-c6e74ba1a3fc None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:26.245089 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e683865-18d3-4d08-8ae6-e11946c14370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:26.246085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683865-18d3-4d08-8ae6-e11946c14370 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:26.246574 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683865-18d3-4d08-8ae6-e11946c14370 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:26.247053 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683865-18d3-4d08-8ae6-e11946c14370 None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:26.247967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e683865-18d3-4d08-8ae6-e11946c14370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:26.248671 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e683865-18d3-4d08-8ae6-e11946c14370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:26.250402 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e683865-18d3-4d08-8ae6-e11946c14370 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:26.262244 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 259/525] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:26.263323 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e683865-18d3-4d08-8ae6-e11946c14370 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:26.284693 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25e022-dc84-46a2-86ce-9acb56976634 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:26.318471 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd9d7b-2427-4ccd-bac8-51d9cb6b29d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:26.319227 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd9d7b-2427-4ccd-bac8-51d9cb6b29d5 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:26.319585 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd9d7b-2427-4ccd-bac8-51d9cb6b29d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:26.319935 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd9d7b-2427-4ccd-bac8-51d9cb6b29d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:26.320814 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd9d7b-2427-4ccd-bac8-51d9cb6b29d5 None admin] RBAC: Adding query filter params (role.id=78258bf52d1f4340bb3f7eda6a73f71a, scope.project.id=758931ec3ed54a1eadf1b9a463fbb241, user.id=b1bb8a2281ef49be8b2501dd399bbfe4) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:26.321130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd9d7b-2427-4ccd-bac8-51d9cb6b29d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:26.322818 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd9d7b-2427-4ccd-bac8-51d9cb6b29d5 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:26.328909 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 267/526] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:44:26 2022] GET /identity/v3/role_assignments?user.id=b1bb8a2281ef49be8b2501dd399bbfe4&scope.project.id=758931ec3ed54a1eadf1b9a463fbb241&role.id=78258bf52d1f4340bb3f7eda6a73f71a => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:26.329937 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd9d7b-2427-4ccd-bac8-51d9cb6b29d5 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:26.367815 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e683865-18d3-4d08-8ae6-e11946c14370 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:26.405889 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267d88f-f446-4d75-8791-0b971c7f008a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:26.406102 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267d88f-f446-4d75-8791-0b971c7f008a None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:26.406384 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267d88f-f446-4d75-8791-0b971c7f008a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:26.406635 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267d88f-f446-4d75-8791-0b971c7f008a None admin] PATH_INFO: `/v3/projects` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:26.407435 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267d88f-f446-4d75-8791-0b971c7f008a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:26.407748 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267d88f-f446-4d75-8791-0b971c7f008a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:26.409405 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267d88f-f446-4d75-8791-0b971c7f008a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:26.422852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 260/527] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:44:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:26.428969 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267d88f-f446-4d75-8791-0b971c7f008a None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:26.447096 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd9d7b-2427-4ccd-bac8-51d9cb6b29d5 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:26.483716 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d9e29-9770-485e-8a95-e0255f55b52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:26.556280 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d9e29-9770-485e-8a95-e0255f55b52d None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:26.556280 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d9e29-9770-485e-8a95-e0255f55b52d None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:26.556280 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d9e29-9770-485e-8a95-e0255f55b52d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:26.556280 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d9e29-9770-485e-8a95-e0255f55b52d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:26.556280 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d9e29-9770-485e-8a95-e0255f55b52d None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:26.556280 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-b36d9e29-9770-485e-8a95-e0255f55b52d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:26.556280 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:26.556800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:26.556800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:26.556800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:26.556800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:26.556800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:26.556800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:26.556800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:26.556800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:26.556800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:26.556800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:26.556800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:44:26.556800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:44:26.556800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:44:26.556800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:44:26.556800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:26.556800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:26.557638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:26.557638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:26.557638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:26.557638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:26.557638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:26.557638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:26.557638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:26.557638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:26.557638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:26.557638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:26.557638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:26.557638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:26.557638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:26.557638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:26.557638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:44:26.557638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:44:26.557638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:44:26.558504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:44:26.558504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:44:26.558504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:44:26.558504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:26.558504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:26.558504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 268/528] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:26.558504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d9e29-9770-485e-8a95-e0255f55b52d None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:26.558884 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267d88f-f446-4d75-8791-0b971c7f008a None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:26.584220 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff8d97-8406-4c8b-80e9-59f8165b078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:26.584942 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff8d97-8406-4c8b-80e9-59f8165b078a None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:26.585237 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff8d97-8406-4c8b-80e9-59f8165b078a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:26.585517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff8d97-8406-4c8b-80e9-59f8165b078a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:26.586356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff8d97-8406-4c8b-80e9-59f8165b078a None admin] RBAC: Adding query filter params (role.id=78258bf52d1f4340bb3f7eda6a73f71a, scope.project.id=758931ec3ed54a1eadf1b9a463fbb241, user.id=351c1af1091f4f97962da2c5e2d330d5) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:26.586670 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff8d97-8406-4c8b-80e9-59f8165b078a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:26.588149 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff8d97-8406-4c8b-80e9-59f8165b078a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:26.594226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 261/529] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:44:26 2022] GET /identity/v3/role_assignments?user.id=351c1af1091f4f97962da2c5e2d330d5&scope.project.id=758931ec3ed54a1eadf1b9a463fbb241&role.id=78258bf52d1f4340bb3f7eda6a73f71a => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:26.649931 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d9e29-9770-485e-8a95-e0255f55b52d None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:26.688834 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ecb99-5a0a-4eb6-8604-97ec29a9bbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:26.689512 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ecb99-5a0a-4eb6-8604-97ec29a9bbf2 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:26.689794 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ecb99-5a0a-4eb6-8604-97ec29a9bbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:26.690067 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ecb99-5a0a-4eb6-8604-97ec29a9bbf2 None admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:26.690866 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ecb99-5a0a-4eb6-8604-97ec29a9bbf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:26.691173 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ecb99-5a0a-4eb6-8604-97ec29a9bbf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:26.696971 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ecb99-5a0a-4eb6-8604-97ec29a9bbf2 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:26.717977 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 269/530] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:44:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:26.723574 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff8d97-8406-4c8b-80e9-59f8165b078a None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:26.832603 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff8d97-8406-4c8b-80e9-59f8165b078a None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:26.867345 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c2b34-6bee-4242-b6dc-07033a7d3615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:26.868003 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c2b34-6bee-4242-b6dc-07033a7d3615 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:26.868314 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c2b34-6bee-4242-b6dc-07033a7d3615 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:26.868588 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c2b34-6bee-4242-b6dc-07033a7d3615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:26.869408 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c2b34-6bee-4242-b6dc-07033a7d3615 None admin] RBAC: Adding query filter params (role.id=78258bf52d1f4340bb3f7eda6a73f71a, scope.project.id=758931ec3ed54a1eadf1b9a463fbb241, user.id=31e2b07c860d4316b35b1656f2f1c1aa) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:26.869716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c2b34-6bee-4242-b6dc-07033a7d3615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:26.871164 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c2b34-6bee-4242-b6dc-07033a7d3615 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:26.877657 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 262/531] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:44:26 2022] GET /identity/v3/role_assignments?user.id=31e2b07c860d4316b35b1656f2f1c1aa&scope.project.id=758931ec3ed54a1eadf1b9a463fbb241&role.id=78258bf52d1f4340bb3f7eda6a73f71a => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:28.307852 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd52a8-50ec-4fb1-b1a2-51f9a6628c71 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:28.308766 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd52a8-50ec-4fb1-b1a2-51f9a6628c71 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:28.309215 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd52a8-50ec-4fb1-b1a2-51f9a6628c71 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:28.311032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 270/532] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:28.316780 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f3bfb-8147-40c3-9302-6e1a9bf98056 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:28.317642 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f3bfb-8147-40c3-9302-6e1a9bf98056 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:28.318135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f3bfb-8147-40c3-9302-6e1a9bf98056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:28.336008 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-9d4f3bfb-8147-40c3-9302-6e1a9bf98056 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:28.337553 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-9d4f3bfb-8147-40c3-9302-6e1a9bf98056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:28.408241 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 263/533] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:28.432460 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd52a8-50ec-4fb1-b1a2-51f9a6628c71 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:28.542889 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd52a8-50ec-4fb1-b1a2-51f9a6628c71 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:28.580092 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138707f2-7a52-4f2e-aab9-166cff026a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:28.581173 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138707f2-7a52-4f2e-aab9-166cff026a2a None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:28.581640 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138707f2-7a52-4f2e-aab9-166cff026a2a None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:28.582093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138707f2-7a52-4f2e-aab9-166cff026a2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:28.594419 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138707f2-7a52-4f2e-aab9-166cff026a2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:28.602047 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-138707f2-7a52-4f2e-aab9-166cff026a2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:28.602047 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:28.602047 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:28.602047 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:28.602047 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:28.602047 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:28.602047 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:28.602047 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:28.602047 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:28.602047 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:28.602047 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:28.602047 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:28.602047 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:28.602047 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:28.602047 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:28.602047 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:28.603071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:28.603071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:28.603071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:28.603071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:28.603071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:28.603071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:28.603071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:28.603071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:28.603071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:28.603071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:28.603071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:28.603071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:28.603071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:28.603071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:28.603071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:28.603071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:28.603887 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:28.603887 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:28.603887 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:28.603887 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:28.603887 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:28.603887 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:28.603887 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:28.603887 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:28.603887 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:28.603887 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:28.603887 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:28.603887 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:28.603887 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 271/534] 10.222.0.18 () {56 vars in 1102 bytes} [Mon May 2 08:44:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:28.611479 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f3bfb-8147-40c3-9302-6e1a9bf98056 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:28.710384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb9179-713e-45d2-ab8c-f4a218500199 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:28.710995 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb9179-713e-45d2-ab8c-f4a218500199 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:28.710995 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb9179-713e-45d2-ab8c-f4a218500199 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:28.712581 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 272/535] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:28.718841 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497e2a2-6ff7-411d-b31a-48d0f9bc6270 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:28.718841 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497e2a2-6ff7-411d-b31a-48d0f9bc6270 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:28.719196 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497e2a2-6ff7-411d-b31a-48d0f9bc6270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:28.727951 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f3bfb-8147-40c3-9302-6e1a9bf98056 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:28.736094 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-6497e2a2-6ff7-411d-b31a-48d0f9bc6270 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:28.737083 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-6497e2a2-6ff7-411d-b31a-48d0f9bc6270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:28.763400 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab97a6-4ddb-4214-bacb-fd6427415096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:28.764623 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab97a6-4ddb-4214-bacb-fd6427415096 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:28.765071 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab97a6-4ddb-4214-bacb-fd6427415096 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:28.765185 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab97a6-4ddb-4214-bacb-fd6427415096 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:28.765896 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab97a6-4ddb-4214-bacb-fd6427415096 None admin] RBAC: Adding query filter params (name=service) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:28.766202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab97a6-4ddb-4214-bacb-fd6427415096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:28.767631 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab97a6-4ddb-4214-bacb-fd6427415096 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:28.776499 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 264/536] 10.222.0.18 () {56 vars in 1103 bytes} [Mon May 2 08:44:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:28.782808 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab97a6-4ddb-4214-bacb-fd6427415096 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:28.807663 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 273/537] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:28.832172 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497e2a2-6ff7-411d-b31a-48d0f9bc6270 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:28.888276 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab97a6-4ddb-4214-bacb-fd6427415096 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:28.930728 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d173174-d915-4dd6-99a1-5159e9913f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:28.931533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d173174-d915-4dd6-99a1-5159e9913f86 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:28.931811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d173174-d915-4dd6-99a1-5159e9913f86 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:28.932108 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d173174-d915-4dd6-99a1-5159e9913f86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:28.943548 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d173174-d915-4dd6-99a1-5159e9913f86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:28.945113 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d173174-d915-4dd6-99a1-5159e9913f86 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:28.947049 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497e2a2-6ff7-411d-b31a-48d0f9bc6270 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:28.963470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-3d173174-d915-4dd6-99a1-5159e9913f86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:28.963470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:28.963470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:28.963470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:28.963470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:28.963470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:28.963470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:28.963470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:28.963470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:28.963470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:28.963470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:28.963470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:28.963470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:28.963470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:28.963470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:28.964437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:28.964437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:28.964437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:28.964437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:28.964437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:28.964437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:28.964437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:28.964437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:28.964437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:28.964437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:28.964437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:28.964437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:28.964437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:28.964437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:28.964437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:28.964437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:28.964437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:28.965292 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:28.965292 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:28.965292 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:28.965292 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:28.965292 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 265/538] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:28.971064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d173174-d915-4dd6-99a1-5159e9913f86 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:28.995121 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a0511-d7b0-46bd-a3d1-2bbcc9ee64d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:28.996658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a0511-d7b0-46bd-a3d1-2bbcc9ee64d5 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:28.997383 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a0511-d7b0-46bd-a3d1-2bbcc9ee64d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:28.997928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a0511-d7b0-46bd-a3d1-2bbcc9ee64d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:29.018038 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a0511-d7b0-46bd-a3d1-2bbcc9ee64d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:29.029363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-d36a0511-d7b0-46bd-a3d1-2bbcc9ee64d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:29.029363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:29.029363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:29.029363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:29.029363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:29.029363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:29.029363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:29.029363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:29.029363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:29.029363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:29.029363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:29.029363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:29.029363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:29.029363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:29.029363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:29.029363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:29.030332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:29.030332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:29.030332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:29.030332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:29.030332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:29.030332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:29.030332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:29.030332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:29.030332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:29.030332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:29.030332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:29.030332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:29.030332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:29.030332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:29.030332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:29.030332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:29.031253 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:29.031253 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:29.031253 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:29.031253 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:29.031253 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:29.031253 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:29.031253 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:29.031253 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:29.031253 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:29.031253 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:29.031253 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:29.031253 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:29.034452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 274/539] 10.222.0.18 () {56 vars in 1102 bytes} [Mon May 2 08:44:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:29.039089 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10120b7c-82e8-48a4-8f59-0624906b5454 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:29.039251 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10120b7c-82e8-48a4-8f59-0624906b5454 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:29.039464 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10120b7c-82e8-48a4-8f59-0624906b5454 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:29.040800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 275/540] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:29.041489 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10120b7c-82e8-48a4-8f59-0624906b5454 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:29.089731 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d173174-d915-4dd6-99a1-5159e9913f86 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:29.122312 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b7e72-9aa4-4351-b9dd-d3b31b6d6103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:29.123627 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b7e72-9aa4-4351-b9dd-d3b31b6d6103 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:29.123946 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b7e72-9aa4-4351-b9dd-d3b31b6d6103 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:29.124337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b7e72-9aa4-4351-b9dd-d3b31b6d6103 None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:29.125066 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b7e72-9aa4-4351-b9dd-d3b31b6d6103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:29.125379 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b7e72-9aa4-4351-b9dd-d3b31b6d6103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:29.126780 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b7e72-9aa4-4351-b9dd-d3b31b6d6103 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:29.138376 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 266/541] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:29.139727 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3a64c-33ac-460f-a4ab-3cab441f255c None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:29.140016 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3a64c-33ac-460f-a4ab-3cab441f255c None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:29.140338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3a64c-33ac-460f-a4ab-3cab441f255c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:29.148317 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10120b7c-82e8-48a4-8f59-0624906b5454 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:29.157696 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-30f3a64c-33ac-460f-a4ab-3cab441f255c None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:29.158879 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-30f3a64c-33ac-460f-a4ab-3cab441f255c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:29.182221 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf12c4e-37ed-4107-a65c-4dcd5b40aae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:29.182867 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf12c4e-37ed-4107-a65c-4dcd5b40aae8 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:29.183150 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf12c4e-37ed-4107-a65c-4dcd5b40aae8 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:29.183436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf12c4e-37ed-4107-a65c-4dcd5b40aae8 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:29.184189 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf12c4e-37ed-4107-a65c-4dcd5b40aae8 None admin] RBAC: Adding query filter params (name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:29.184499 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf12c4e-37ed-4107-a65c-4dcd5b40aae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:29.186724 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf12c4e-37ed-4107-a65c-4dcd5b40aae8 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:29.195095 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 276/542] 10.222.0.18 () {56 vars in 1103 bytes} [Mon May 2 08:44:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:29.195894 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf12c4e-37ed-4107-a65c-4dcd5b40aae8 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:29.225109 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 267/543] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:29.226413 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bc83f-f678-4c6c-a749-618526a4e383 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:29.226705 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bc83f-f678-4c6c-a749-618526a4e383 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:29.226986 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bc83f-f678-4c6c-a749-618526a4e383 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:29.228374 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 268/544] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:29.232084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bc83f-f678-4c6c-a749-618526a4e383 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:29.294649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf12c4e-37ed-4107-a65c-4dcd5b40aae8 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:29.328033 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bc83f-f678-4c6c-a749-618526a4e383 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:29.328775 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9eb9b-9ec7-47ac-945a-af3ccfe8ad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:29.329560 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9eb9b-9ec7-47ac-945a-af3ccfe8ad58 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:29.329838 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9eb9b-9ec7-47ac-945a-af3ccfe8ad58 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:29.330115 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9eb9b-9ec7-47ac-945a-af3ccfe8ad58 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:29.336960 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9eb9b-9ec7-47ac-945a-af3ccfe8ad58 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:29.338405 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9eb9b-9ec7-47ac-945a-af3ccfe8ad58 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:29.353651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-d3f9eb9b-9ec7-47ac-945a-af3ccfe8ad58 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 02 08:44:29.353651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:29.353651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:29.353651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:29.353651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:29.353651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:29.353651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:29.353651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:29.353651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:29.353651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:29.353651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:29.353651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:29.353651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:44:29.353651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:44:29.353651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:44:29.353651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:44:29.354588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:29.354588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:29.354588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:44:29.354588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:29.354588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:44:29.354588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:29.354588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:29.354588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:29.354588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:29.354588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:29.354588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:29.354588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:29.354588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:29.354588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:29.354588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:29.354588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:29.354588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:29.354588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:29.355502 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:29.355502 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:29.355502 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:44:29.355502 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:44:29.355502 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:44:29.355502 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:44:29.355502 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:44:29.355502 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:44:29.355502 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 02 08:44:29.355502 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:29.355502 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 277/545] 10.222.0.18 () {56 vars in 1093 bytes} [Mon May 2 08:44:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:29.356131 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f596ebd-72e4-4118-b1c2-2448d6cf6d62 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:29.356215 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f596ebd-72e4-4118-b1c2-2448d6cf6d62 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:29.356515 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f596ebd-72e4-4118-b1c2-2448d6cf6d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:29.364698 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44771f-d727-419b-952d-e823d0941b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:29.365491 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44771f-d727-419b-952d-e823d0941b64 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:29.365773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44771f-d727-419b-952d-e823d0941b64 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:29.366041 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44771f-d727-419b-952d-e823d0941b64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:29.372683 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-9f596ebd-72e4-4118-b1c2-2448d6cf6d62 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:29.373928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-9f596ebd-72e4-4118-b1c2-2448d6cf6d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:29.376028 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44771f-d727-419b-952d-e823d0941b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:29.377523 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44771f-d727-419b-952d-e823d0941b64 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:29.394373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-bc44771f-d727-419b-952d-e823d0941b64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:29.394373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:29.394373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:29.394373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:29.394373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:29.394373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:29.394373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:29.394373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:29.394373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:29.394373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:29.394373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:29.394373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:29.394373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:29.394373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:29.394373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:29.399245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:29.399245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:29.399245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:29.399245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:29.399245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:29.399245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:29.399245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:29.399245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:29.399245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:29.399245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:29.399245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:29.399245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:29.399245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:29.399245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:29.399245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:29.399245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:29.399245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:29.400909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:29.400909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:29.400909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:29.400909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:29.400909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 269/546] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:29.400909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44771f-d727-419b-952d-e823d0941b64 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:29.437819 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 278/547] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:29.448585 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f596ebd-72e4-4118-b1c2-2448d6cf6d62 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:29.491352 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44771f-d727-419b-952d-e823d0941b64 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:29.523133 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ac817-3cd0-4cc5-98f7-ae24675f9ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:29.523934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ac817-3cd0-4cc5-98f7-ae24675f9ff0 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:29.524241 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ac817-3cd0-4cc5-98f7-ae24675f9ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:29.524518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ac817-3cd0-4cc5-98f7-ae24675f9ff0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:29.532834 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f596ebd-72e4-4118-b1c2-2448d6cf6d62 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:29.534745 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ac817-3cd0-4cc5-98f7-ae24675f9ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:29.542554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-735ac817-3cd0-4cc5-98f7-ae24675f9ff0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:29.542554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:29.542554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:29.542554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:29.542554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:29.542554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:29.542554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:29.542554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:29.542554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:29.542554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:29.542554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:29.542554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:29.542554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:29.542554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:29.542554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:29.542554 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:29.549122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:29.549122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:29.549122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:29.549122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:29.549122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:29.549122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:29.549122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:29.549122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:29.549122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:29.549122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:29.549122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:29.549122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:29.549122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:29.549122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:29.549122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:29.549122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:29.549922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:29.549922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:29.549922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:29.549922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:29.549922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:29.549922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:29.549922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:29.549922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:29.549922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:29.549922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:29.549922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:29.549922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:29.549922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 270/548] 10.222.0.18 () {56 vars in 1102 bytes} [Mon May 2 08:44:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:29.549922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ac817-3cd0-4cc5-98f7-ae24675f9ff0 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:29.568416 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb18044-ac0d-40ef-850c-405408be4e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:29.569081 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb18044-ac0d-40ef-850c-405408be4e65 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:29.569367 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb18044-ac0d-40ef-850c-405408be4e65 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:29.569645 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb18044-ac0d-40ef-850c-405408be4e65 None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:29.570467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb18044-ac0d-40ef-850c-405408be4e65 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:29.570777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb18044-ac0d-40ef-850c-405408be4e65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:29.572635 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb18044-ac0d-40ef-850c-405408be4e65 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:29.589245 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 279/549] 10.222.0.18 () {56 vars in 1133 bytes} [Mon May 2 08:44:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:29.590142 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb18044-ac0d-40ef-850c-405408be4e65 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:29.645239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ac817-3cd0-4cc5-98f7-ae24675f9ff0 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:29.677683 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4746f9e-8f96-4e9c-8e41-16be142fa9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:29.678351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4746f9e-8f96-4e9c-8e41-16be142fa9a0 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:29.678627 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4746f9e-8f96-4e9c-8e41-16be142fa9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:29.678899 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4746f9e-8f96-4e9c-8e41-16be142fa9a0 None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:29.679610 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4746f9e-8f96-4e9c-8e41-16be142fa9a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:29.679916 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4746f9e-8f96-4e9c-8e41-16be142fa9a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:29.681315 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4746f9e-8f96-4e9c-8e41-16be142fa9a0 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:29.687838 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb18044-ac0d-40ef-850c-405408be4e65 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:29.693135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 271/550] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:29.693882 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4746f9e-8f96-4e9c-8e41-16be142fa9a0 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:29.720824 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b502e-42c6-4407-ab24-7b4ef7a7cbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:29.721609 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b502e-42c6-4407-ab24-7b4ef7a7cbc1 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:29.721886 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b502e-42c6-4407-ab24-7b4ef7a7cbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:29.722155 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b502e-42c6-4407-ab24-7b4ef7a7cbc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:29.731681 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b502e-42c6-4407-ab24-7b4ef7a7cbc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:29.739445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-ad0b502e-42c6-4407-ab24-7b4ef7a7cbc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:29.739445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:29.739445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:29.739445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:29.739445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:29.739445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:29.739445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:29.739445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:29.739445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:29.739445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:29.739445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:29.739445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:29.739445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:29.739445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:29.739445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:29.739445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:29.740602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:29.740602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:29.740602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:29.740602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:29.740602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:29.740602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:29.740602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:29.740602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:29.740602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:29.740602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:29.740602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:29.740602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:29.740602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:29.740602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:29.740602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:29.740602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:29.741405 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:29.741405 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:29.741405 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:29.741405 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:29.741405 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:29.741405 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:29.741405 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:29.741405 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:29.741405 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:29.741405 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:29.741405 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:29.741405 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:29.741405 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 280/551] 10.222.0.18 () {56 vars in 1102 bytes} [Mon May 2 08:44:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:29.742062 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b502e-42c6-4407-ab24-7b4ef7a7cbc1 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:29.786963 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4746f9e-8f96-4e9c-8e41-16be142fa9a0 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:29.819205 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578e206-5308-41a9-9e01-071d5004d828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:29.819863 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578e206-5308-41a9-9e01-071d5004d828 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:29.820184 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578e206-5308-41a9-9e01-071d5004d828 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:29.820462 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578e206-5308-41a9-9e01-071d5004d828 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:29.821196 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578e206-5308-41a9-9e01-071d5004d828 None admin] RBAC: Adding query filter params (name=service) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:29.821504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578e206-5308-41a9-9e01-071d5004d828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:29.823122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578e206-5308-41a9-9e01-071d5004d828 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:29.835356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 272/552] 10.222.0.18 () {56 vars in 1103 bytes} [Mon May 2 08:44:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:29.835356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578e206-5308-41a9-9e01-071d5004d828 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:29.836353 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b502e-42c6-4407-ab24-7b4ef7a7cbc1 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:29.868611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085caec-dc32-4919-b1be-a5432aed9209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:29.869393 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085caec-dc32-4919-b1be-a5432aed9209 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:29.869676 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085caec-dc32-4919-b1be-a5432aed9209 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:29.869953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085caec-dc32-4919-b1be-a5432aed9209 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:29.880436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085caec-dc32-4919-b1be-a5432aed9209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:29.881889 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085caec-dc32-4919-b1be-a5432aed9209 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:29.899621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-0085caec-dc32-4919-b1be-a5432aed9209 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:29.899621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:29.899621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:29.899621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:29.899621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:29.899621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:29.899621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:29.899621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:29.899621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:29.899621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:29.899621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:29.899621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:29.899621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:29.899621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:29.899621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:29.900569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:29.900569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:29.900569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:29.900569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:29.900569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:29.900569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:29.900569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:29.900569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:29.900569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:29.900569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:29.900569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:29.900569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:29.900569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:29.900569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:29.900569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:29.900569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:29.900569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:29.901414 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:29.901414 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:29.901414 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:29.901414 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:29.901414 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 281/553] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:29.901689 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085caec-dc32-4919-b1be-a5432aed9209 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:29.928741 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578e206-5308-41a9-9e01-071d5004d828 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:29.960617 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be14a5-10f3-4ea3-85a2-1e191efa8a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:29.961410 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be14a5-10f3-4ea3-85a2-1e191efa8a92 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:29.961715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be14a5-10f3-4ea3-85a2-1e191efa8a92 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:29.961991 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be14a5-10f3-4ea3-85a2-1e191efa8a92 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:29.969748 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be14a5-10f3-4ea3-85a2-1e191efa8a92 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:29.971188 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be14a5-10f3-4ea3-85a2-1e191efa8a92 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:29.984897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-78be14a5-10f3-4ea3-85a2-1e191efa8a92 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 02 08:44:29.984897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:29.984897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:29.984897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:29.984897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:29.984897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:29.984897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:29.984897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:29.984897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:29.984897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:29.984897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:29.984897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:29.984897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:44:29.984897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:44:29.984897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:44:29.984897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:44:29.985817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:29.985817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:29.985817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:44:29.985817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:29.985817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:44:29.985817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:29.985817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:29.985817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:29.985817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:29.985817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:29.985817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:29.985817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:29.985817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:29.985817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:29.985817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:29.985817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:29.985817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:29.985817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:29.986994 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:29.986994 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:29.986994 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:44:29.986994 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:44:29.986994 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:44:29.986994 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:44:29.986994 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:44:29.986994 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:44:29.986994 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 02 08:44:29.986994 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:29.986994 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 273/554] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:29.986994 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be14a5-10f3-4ea3-85a2-1e191efa8a92 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:29.999493 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085caec-dc32-4919-b1be-a5432aed9209 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:30.032288 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a944b7-dee7-4ed1-93d3-1c3697e0fc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:30.032946 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a944b7-dee7-4ed1-93d3-1c3697e0fc24 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:30.033229 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a944b7-dee7-4ed1-93d3-1c3697e0fc24 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:30.033503 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a944b7-dee7-4ed1-93d3-1c3697e0fc24 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:30.034241 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a944b7-dee7-4ed1-93d3-1c3697e0fc24 None admin] RBAC: Adding query filter params (name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:30.034549 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a944b7-dee7-4ed1-93d3-1c3697e0fc24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:30.035915 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a944b7-dee7-4ed1-93d3-1c3697e0fc24 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:30.048286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 282/555] 10.222.0.18 () {56 vars in 1103 bytes} [Mon May 2 08:44:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:30.048286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a944b7-dee7-4ed1-93d3-1c3697e0fc24 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:30.081071 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be14a5-10f3-4ea3-85a2-1e191efa8a92 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:30.112495 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271b52f-1ed4-4c21-aa11-de0513cfef21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:30.113280 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271b52f-1ed4-4c21-aa11-de0513cfef21 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:30.113560 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271b52f-1ed4-4c21-aa11-de0513cfef21 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:30.113836 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271b52f-1ed4-4c21-aa11-de0513cfef21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:30.124436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271b52f-1ed4-4c21-aa11-de0513cfef21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:30.125899 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271b52f-1ed4-4c21-aa11-de0513cfef21 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:30.140270 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a944b7-dee7-4ed1-93d3-1c3697e0fc24 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:30.142172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-7271b52f-1ed4-4c21-aa11-de0513cfef21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:30.142172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:30.142172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:30.142172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:30.142172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:30.142172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:30.142172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:30.142172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:30.142172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:30.142172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:30.142172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:30.142172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:30.142172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:30.142172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:30.142172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:30.143217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:30.143217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:30.143217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:30.143217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:30.143217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:30.143217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:30.143217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:30.143217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:30.143217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:30.143217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:30.143217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:30.143217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:30.143217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:30.143217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:30.143217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:30.143217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:30.143217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:30.148792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:30.148792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:30.148792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:30.148792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:30.148792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 274/556] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:30.148792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271b52f-1ed4-4c21-aa11-de0513cfef21 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:30.173559 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c556ac-6c32-41bd-8bd2-3981b08fd730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:30.174211 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c556ac-6c32-41bd-8bd2-3981b08fd730 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:30.174490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c556ac-6c32-41bd-8bd2-3981b08fd730 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:30.174759 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c556ac-6c32-41bd-8bd2-3981b08fd730 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:30.175460 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c556ac-6c32-41bd-8bd2-3981b08fd730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:30.175762 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c556ac-6c32-41bd-8bd2-3981b08fd730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:30.177150 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c556ac-6c32-41bd-8bd2-3981b08fd730 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:30.188416 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 283/557] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:30.189193 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c556ac-6c32-41bd-8bd2-3981b08fd730 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:30.237522 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271b52f-1ed4-4c21-aa11-de0513cfef21 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:30.269134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7d458-5ac9-4a4d-8f79-8ff6dafad6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:30.279226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7d458-5ac9-4a4d-8f79-8ff6dafad6de None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:30.279226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7d458-5ac9-4a4d-8f79-8ff6dafad6de None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:30.279226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7d458-5ac9-4a4d-8f79-8ff6dafad6de None admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:30.279226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7d458-5ac9-4a4d-8f79-8ff6dafad6de None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:30.279226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7d458-5ac9-4a4d-8f79-8ff6dafad6de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:30.279226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7d458-5ac9-4a4d-8f79-8ff6dafad6de None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:30.281714 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c556ac-6c32-41bd-8bd2-3981b08fd730 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:30.289342 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 275/558] 10.222.0.18 () {56 vars in 1137 bytes} [Mon May 2 08:44:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:30.290128 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7d458-5ac9-4a4d-8f79-8ff6dafad6de None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:30.314588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f91d35-378c-41e3-a6c5-ed767edb0532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:30.315369 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f91d35-378c-41e3-a6c5-ed767edb0532 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:30.315647 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f91d35-378c-41e3-a6c5-ed767edb0532 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:30.315917 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f91d35-378c-41e3-a6c5-ed767edb0532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:30.325792 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f91d35-378c-41e3-a6c5-ed767edb0532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:30.327844 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f91d35-378c-41e3-a6c5-ed767edb0532 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:30.344953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-f2f91d35-378c-41e3-a6c5-ed767edb0532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:30.344953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:30.344953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:30.344953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:30.344953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:30.344953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:30.344953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:30.344953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:30.344953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:30.344953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:30.344953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:30.344953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:30.344953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:30.344953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:30.344953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:30.346286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:30.346286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:30.346286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:30.346286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:30.346286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:30.346286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:30.346286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:30.346286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:30.346286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:30.346286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:30.346286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:30.346286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:30.346286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:30.346286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:30.346286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:30.346286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:30.346286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:30.347114 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:30.347114 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:30.347114 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:30.347114 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:30.347114 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 284/559] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:30.347114 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f91d35-378c-41e3-a6c5-ed767edb0532 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:30.384874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7d458-5ac9-4a4d-8f79-8ff6dafad6de None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:30.417798 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcd3a8-ee83-434c-9cec-1ff02b408f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:30.418490 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcd3a8-ee83-434c-9cec-1ff02b408f9a None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:30.418773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcd3a8-ee83-434c-9cec-1ff02b408f9a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:30.419048 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcd3a8-ee83-434c-9cec-1ff02b408f9a None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:30.419998 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcd3a8-ee83-434c-9cec-1ff02b408f9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:30.420352 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcd3a8-ee83-434c-9cec-1ff02b408f9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:30.421739 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcd3a8-ee83-434c-9cec-1ff02b408f9a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:30.432588 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 276/560] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:30.433301 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcd3a8-ee83-434c-9cec-1ff02b408f9a None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:30.443607 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f91d35-378c-41e3-a6c5-ed767edb0532 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:30.476225 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89388206-d3e5-40e6-9f0e-2cc2a52dbc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:30.477013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89388206-d3e5-40e6-9f0e-2cc2a52dbc2c None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:30.477292 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89388206-d3e5-40e6-9f0e-2cc2a52dbc2c None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:30.477566 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89388206-d3e5-40e6-9f0e-2cc2a52dbc2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:30.484584 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89388206-d3e5-40e6-9f0e-2cc2a52dbc2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:30.486046 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89388206-d3e5-40e6-9f0e-2cc2a52dbc2c None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:30.500209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-89388206-d3e5-40e6-9f0e-2cc2a52dbc2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:30.500209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:30.500209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:30.500209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:30.500209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:30.500209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:30.500209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:30.500209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:30.500209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:30.500209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:30.500209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:30.500209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:30.500209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:44:30.500209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:44:30.500209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:44:30.501243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:44:30.501243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:30.501243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:30.501243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:30.501243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:30.501243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:30.501243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:30.501243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:30.501243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:30.501243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:30.501243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:30.501243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:30.501243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:30.501243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:30.501243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:30.501243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:30.501243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:30.502140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:44:30.502140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:44:30.502140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:44:30.502140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:44:30.502140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:44:30.502140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:44:30.502140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:30.502140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:30.502140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 285/561] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:30.503148 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89388206-d3e5-40e6-9f0e-2cc2a52dbc2c None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:30.528607 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcd3a8-ee83-434c-9cec-1ff02b408f9a None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:30.560345 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd70e04-556e-428e-ade5-ec698a537d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:30.562271 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd70e04-556e-428e-ade5-ec698a537d75 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:30.562562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd70e04-556e-428e-ade5-ec698a537d75 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:30.562840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd70e04-556e-428e-ade5-ec698a537d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:30.573805 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd70e04-556e-428e-ade5-ec698a537d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:30.575278 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd70e04-556e-428e-ade5-ec698a537d75 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:30.592887 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-7cd70e04-556e-428e-ade5-ec698a537d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:30.592887 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:30.592887 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:30.592887 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:30.592887 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:30.592887 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:30.592887 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:30.592887 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:30.592887 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:30.592887 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:30.592887 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:30.592887 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:30.592887 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:30.592887 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:30.592887 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:30.594240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:30.594240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:30.594240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:30.594240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:30.594240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:30.594240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:30.594240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:30.594240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:30.594240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:30.594240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:30.594240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:30.594240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:30.594240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:30.594240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:30.594240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:30.594240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:30.594240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:30.595111 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:30.595111 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:30.595111 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:30.595111 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:30.595111 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 277/562] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:30.595381 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd70e04-556e-428e-ade5-ec698a537d75 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:30.598302 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89388206-d3e5-40e6-9f0e-2cc2a52dbc2c None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:30.630131 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700e9ce-cca8-4e24-b2de-98207612aae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:30.630786 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700e9ce-cca8-4e24-b2de-98207612aae0 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:30.631066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700e9ce-cca8-4e24-b2de-98207612aae0 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:30.631339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700e9ce-cca8-4e24-b2de-98207612aae0 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:30.632091 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700e9ce-cca8-4e24-b2de-98207612aae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:30.632377 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700e9ce-cca8-4e24-b2de-98207612aae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:30.633745 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700e9ce-cca8-4e24-b2de-98207612aae0 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:30.646111 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 286/563] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:30.646831 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700e9ce-cca8-4e24-b2de-98207612aae0 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:30.691756 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd70e04-556e-428e-ade5-ec698a537d75 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:30.721890 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a1ba6-ee4a-4d3a-a41c-ad89a537b564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:30.722691 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a1ba6-ee4a-4d3a-a41c-ad89a537b564 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:30.722974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a1ba6-ee4a-4d3a-a41c-ad89a537b564 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:30.723249 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a1ba6-ee4a-4d3a-a41c-ad89a537b564 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:30.730607 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a1ba6-ee4a-4d3a-a41c-ad89a537b564 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:30.732084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a1ba6-ee4a-4d3a-a41c-ad89a537b564 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:30.741616 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700e9ce-cca8-4e24-b2de-98207612aae0 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:30.746615 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-ca8a1ba6-ee4a-4d3a-a41c-ad89a537b564 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 02 08:44:30.746615 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:30.746615 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:30.746615 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:30.746615 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:30.746615 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:30.746615 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:30.746615 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:30.746615 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:30.746615 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:30.746615 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:30.746615 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:30.746615 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:44:30.746615 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:44:30.746615 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:44:30.746615 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:44:30.747975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:30.747975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:30.747975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:44:30.747975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:30.747975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:44:30.747975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:30.747975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:30.747975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:30.747975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:30.747975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:30.747975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:30.747975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:30.747975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:30.747975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:30.747975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:30.747975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:30.747975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:30.747975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:30.749431 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:30.749431 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:30.749431 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:44:30.749431 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:44:30.749431 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:44:30.749431 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:44:30.749431 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:44:30.749431 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:44:30.749431 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 02 08:44:30.749431 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:30.749431 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 278/564] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:30.749431 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a1ba6-ee4a-4d3a-a41c-ad89a537b564 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:30.774537 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33deb058-8859-4e43-a1e1-d2772ab68b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:30.775192 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33deb058-8859-4e43-a1e1-d2772ab68b2b None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:30.775538 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33deb058-8859-4e43-a1e1-d2772ab68b2b None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:30.775809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33deb058-8859-4e43-a1e1-d2772ab68b2b None admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:30.776606 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33deb058-8859-4e43-a1e1-d2772ab68b2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:30.776910 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33deb058-8859-4e43-a1e1-d2772ab68b2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:30.778329 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33deb058-8859-4e43-a1e1-d2772ab68b2b None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:30.790216 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 287/565] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:44:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:30.791008 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33deb058-8859-4e43-a1e1-d2772ab68b2b None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:30.851555 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a1ba6-ee4a-4d3a-a41c-ad89a537b564 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:30.883651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33deb058-8859-4e43-a1e1-d2772ab68b2b None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:30.884436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5053e4-fca1-4a0c-bd53-abd542b8b510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:30.885105 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5053e4-fca1-4a0c-bd53-abd542b8b510 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:30.885389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5053e4-fca1-4a0c-bd53-abd542b8b510 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:30.885669 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5053e4-fca1-4a0c-bd53-abd542b8b510 None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:30.886383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5053e4-fca1-4a0c-bd53-abd542b8b510 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:30.886690 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5053e4-fca1-4a0c-bd53-abd542b8b510 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:30.888079 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5053e4-fca1-4a0c-bd53-abd542b8b510 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:30.899517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 279/566] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:30.900351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5053e4-fca1-4a0c-bd53-abd542b8b510 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:30.915258 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c607104-a0f7-48de-aadf-f38c76b86e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:30.916065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c607104-a0f7-48de-aadf-f38c76b86e4b None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:30.916350 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c607104-a0f7-48de-aadf-f38c76b86e4b None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:30.916620 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c607104-a0f7-48de-aadf-f38c76b86e4b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:30.924553 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c607104-a0f7-48de-aadf-f38c76b86e4b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:30.925993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c607104-a0f7-48de-aadf-f38c76b86e4b None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:30.939592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-3c607104-a0f7-48de-aadf-f38c76b86e4b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 02 08:44:30.939592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:30.939592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:30.939592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:30.939592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:30.939592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:30.939592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:30.939592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:30.939592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:30.939592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:30.939592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:30.939592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:30.939592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:44:30.939592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:44:30.939592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:44:30.939592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:44:30.940624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:30.940624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:30.940624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:44:30.940624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:30.940624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:44:30.940624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:30.940624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:30.940624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:30.940624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:30.940624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:30.940624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:30.940624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:30.940624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:30.940624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:30.940624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:30.940624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:30.940624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:30.940624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:30.941547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:30.941547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:30.941547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:44:30.941547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:44:30.941547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:44:30.941547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:44:30.941547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:44:30.941547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:44:30.941547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 02 08:44:30.941547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:30.941547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 288/567] 10.222.0.18 () {56 vars in 1102 bytes} [Mon May 2 08:44:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:30.941547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c607104-a0f7-48de-aadf-f38c76b86e4b None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:30.999458 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5053e4-fca1-4a0c-bd53-abd542b8b510 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:31.031250 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3a187-624a-4fc3-b315-766ad0d6ecf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:31.031916 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3a187-624a-4fc3-b315-766ad0d6ecf1 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:31.032226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3a187-624a-4fc3-b315-766ad0d6ecf1 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:31.032504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3a187-624a-4fc3-b315-766ad0d6ecf1 None admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:31.033322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3a187-624a-4fc3-b315-766ad0d6ecf1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:31.033630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3a187-624a-4fc3-b315-766ad0d6ecf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:31.035059 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3a187-624a-4fc3-b315-766ad0d6ecf1 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:31.035187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c607104-a0f7-48de-aadf-f38c76b86e4b None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:31.051566 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 280/568] 10.222.0.18 () {56 vars in 1137 bytes} [Mon May 2 08:44:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:31.052206 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3a187-624a-4fc3-b315-766ad0d6ecf1 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:31.067371 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359a0fc-988c-49a4-b5fd-addbfa785487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:31.068283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359a0fc-988c-49a4-b5fd-addbfa785487 None admin] REQUEST_METHOD: `PUT` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:31.068562 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359a0fc-988c-49a4-b5fd-addbfa785487 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:31.068833 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359a0fc-988c-49a4-b5fd-addbfa785487 None admin] PATH_INFO: `/v3/projects/758931ec3ed54a1eadf1b9a463fbb241/users/97308967556844019594cd0c4abc41fc/roles/78258bf52d1f4340bb3f7eda6a73f71a` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:31.083384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359a0fc-988c-49a4-b5fd-addbfa785487 None admin] RBAC: Authorizing `identity:create_grant(project_id=758931ec3ed54a1eadf1b9a463fbb241, user_id=97308967556844019594cd0c4abc41fc, role_id=78258bf52d1f4340bb3f7eda6a73f71a)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:31.084855 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359a0fc-988c-49a4-b5fd-addbfa785487 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:31.145207 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3a187-624a-4fc3-b315-766ad0d6ecf1 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:31.164549 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 289/569] 10.222.0.18 () {58 vars in 1439 bytes} [Mon May 2 08:44:30 2022] PUT /identity/v3/projects/758931ec3ed54a1eadf1b9a463fbb241/users/97308967556844019594cd0c4abc41fc/roles/78258bf52d1f4340bb3f7eda6a73f71a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:44:31.165382 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359a0fc-988c-49a4-b5fd-addbfa785487 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:31.178302 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bf636-dc97-4bfc-9c31-c207956538f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:31.179130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bf636-dc97-4bfc-9c31-c207956538f7 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:31.179410 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bf636-dc97-4bfc-9c31-c207956538f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:31.179685 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bf636-dc97-4bfc-9c31-c207956538f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:31.188104 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1bf636-dc97-4bfc-9c31-c207956538f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:31.189701 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1bf636-dc97-4bfc-9c31-c207956538f7 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:31.206545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-8a1bf636-dc97-4bfc-9c31-c207956538f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:31.206545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:31.206545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:31.206545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:31.206545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:31.206545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:31.206545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:31.206545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:31.206545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:31.206545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:31.206545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:31.206545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:31.206545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:44:31.206545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:44:31.206545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:44:31.207517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:44:31.207517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:31.207517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:31.207517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:31.207517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:31.207517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:31.207517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:31.207517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:31.207517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:31.207517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:31.207517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:31.207517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:31.207517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:31.207517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:31.207517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:31.207517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:31.207517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:31.209336 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:44:31.209336 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:44:31.209336 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:44:31.209336 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:44:31.209336 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:44:31.209336 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:44:31.209336 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:31.209336 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:31.209336 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 281/570] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:31.209336 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bf636-dc97-4bfc-9c31-c207956538f7 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:31.279718 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359a0fc-988c-49a4-b5fd-addbfa785487 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:31.316089 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d065a-6ed7-4cdb-a6c8-208b3b521ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:31.316773 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d065a-6ed7-4cdb-a6c8-208b3b521ea3 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:31.317053 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d065a-6ed7-4cdb-a6c8-208b3b521ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:31.317325 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d065a-6ed7-4cdb-a6c8-208b3b521ea3 None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:31.318166 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d065a-6ed7-4cdb-a6c8-208b3b521ea3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:31.318470 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d065a-6ed7-4cdb-a6c8-208b3b521ea3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:31.319450 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bf636-dc97-4bfc-9c31-c207956538f7 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:31.319916 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d065a-6ed7-4cdb-a6c8-208b3b521ea3 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:31.338308 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 290/571] 10.222.0.18 () {56 vars in 1139 bytes} [Mon May 2 08:44:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:31.339168 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d065a-6ed7-4cdb-a6c8-208b3b521ea3 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:31.356175 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc0ed9-4e5f-4cf3-b64f-0b219ab441f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:31.358210 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc0ed9-4e5f-4cf3-b64f-0b219ab441f1 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:31.359219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc0ed9-4e5f-4cf3-b64f-0b219ab441f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:31.359219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc0ed9-4e5f-4cf3-b64f-0b219ab441f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:31.371143 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc0ed9-4e5f-4cf3-b64f-0b219ab441f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:31.372785 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc0ed9-4e5f-4cf3-b64f-0b219ab441f1 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:31.391389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-9afc0ed9-4e5f-4cf3-b64f-0b219ab441f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:31.391389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:31.391389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:31.391389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:31.391389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:31.391389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:31.391389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:31.391389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:31.391389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:31.391389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:31.391389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:31.391389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:31.391389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:31.391389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:31.391389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:31.394338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:31.394338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:31.394338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:31.394338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:31.394338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:31.394338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:31.394338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:31.394338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:31.394338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:31.394338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:31.394338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:31.394338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:31.394338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:31.394338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:31.394338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:31.394338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:31.394338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:31.395320 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:31.395320 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:31.395320 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:31.395320 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:31.395320 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 282/572] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:31.395320 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc0ed9-4e5f-4cf3-b64f-0b219ab441f1 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:31.444254 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d065a-6ed7-4cdb-a6c8-208b3b521ea3 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:31.478024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f273c-5809-4b39-b320-cde955cec433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:31.478682 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f273c-5809-4b39-b320-cde955cec433 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:31.478965 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f273c-5809-4b39-b320-cde955cec433 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:31.479241 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f273c-5809-4b39-b320-cde955cec433 None admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:31.480040 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f273c-5809-4b39-b320-cde955cec433 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:31.480364 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f273c-5809-4b39-b320-cde955cec433 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:31.481789 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f273c-5809-4b39-b320-cde955cec433 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:31.490622 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc0ed9-4e5f-4cf3-b64f-0b219ab441f1 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:31.494005 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 291/573] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:44:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:31.494658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f273c-5809-4b39-b320-cde955cec433 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:31.525757 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f6cbb-375a-4ea4-ac6e-501ccd354f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:31.526560 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f6cbb-375a-4ea4-ac6e-501ccd354f29 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:31.526893 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f6cbb-375a-4ea4-ac6e-501ccd354f29 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:31.527220 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f6cbb-375a-4ea4-ac6e-501ccd354f29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:31.538474 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f6cbb-375a-4ea4-ac6e-501ccd354f29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:31.539936 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f6cbb-375a-4ea4-ac6e-501ccd354f29 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:31.557587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-0d2f6cbb-375a-4ea4-ac6e-501ccd354f29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:31.557587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:31.557587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:31.557587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:31.557587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:31.557587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:31.557587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:31.557587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:31.557587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:31.557587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:31.557587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:31.557587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:31.557587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:31.557587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:31.557587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:31.558572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:31.558572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:31.558572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:31.558572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:31.558572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:31.558572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:31.558572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:31.558572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:31.558572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:31.558572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:31.558572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:31.558572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:31.558572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:31.558572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:31.558572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:31.558572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:31.558572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:31.559619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:31.559619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:31.559619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:31.559619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:31.563381 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 283/574] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:31.564245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f6cbb-375a-4ea4-ac6e-501ccd354f29 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:31.593154 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f273c-5809-4b39-b320-cde955cec433 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:31.626372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5c770-8a9d-4d9e-9dc5-52edcd3060ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:31.627046 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5c770-8a9d-4d9e-9dc5-52edcd3060ba None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:31.627370 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5c770-8a9d-4d9e-9dc5-52edcd3060ba None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:31.627644 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5c770-8a9d-4d9e-9dc5-52edcd3060ba None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:31.628387 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5c770-8a9d-4d9e-9dc5-52edcd3060ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:31.628694 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5c770-8a9d-4d9e-9dc5-52edcd3060ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:31.630058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5c770-8a9d-4d9e-9dc5-52edcd3060ba None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:31.641750 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 292/575] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:31.642570 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5c770-8a9d-4d9e-9dc5-52edcd3060ba None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:31.664362 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f6cbb-375a-4ea4-ac6e-501ccd354f29 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:31.697309 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f37a6-2734-47b5-9dc5-d5ee70ade28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:31.698195 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f37a6-2734-47b5-9dc5-d5ee70ade28e None admin] REQUEST_METHOD: `PUT` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:31.698479 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f37a6-2734-47b5-9dc5-d5ee70ade28e None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:31.698752 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f37a6-2734-47b5-9dc5-d5ee70ade28e None admin] PATH_INFO: `/v3/projects/758931ec3ed54a1eadf1b9a463fbb241/users/b1bb8a2281ef49be8b2501dd399bbfe4/roles/78258bf52d1f4340bb3f7eda6a73f71a` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:31.712960 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f37a6-2734-47b5-9dc5-d5ee70ade28e None admin] RBAC: Authorizing `identity:create_grant(project_id=758931ec3ed54a1eadf1b9a463fbb241, user_id=b1bb8a2281ef49be8b2501dd399bbfe4, role_id=78258bf52d1f4340bb3f7eda6a73f71a)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:31.714442 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f37a6-2734-47b5-9dc5-d5ee70ade28e None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:31.738497 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5c770-8a9d-4d9e-9dc5-52edcd3060ba None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:31.770742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c3a2e-5e52-4229-bd80-a4433a846e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:31.771390 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c3a2e-5e52-4229-bd80-a4433a846e3b None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:31.771672 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c3a2e-5e52-4229-bd80-a4433a846e3b None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:31.771944 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c3a2e-5e52-4229-bd80-a4433a846e3b None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:31.772686 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c3a2e-5e52-4229-bd80-a4433a846e3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:31.772992 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c3a2e-5e52-4229-bd80-a4433a846e3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:31.774374 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c3a2e-5e52-4229-bd80-a4433a846e3b None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:31.784994 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 293/576] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:31.786829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c3a2e-5e52-4229-bd80-a4433a846e3b None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:31.863616 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 284/577] 10.222.0.18 () {58 vars in 1439 bytes} [Mon May 2 08:44:31 2022] PUT /identity/v3/projects/758931ec3ed54a1eadf1b9a463fbb241/users/b1bb8a2281ef49be8b2501dd399bbfe4/roles/78258bf52d1f4340bb3f7eda6a73f71a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:44:31.864526 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f37a6-2734-47b5-9dc5-d5ee70ade28e None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:31.884236 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c3a2e-5e52-4229-bd80-a4433a846e3b None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:31.919958 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1e203-46d8-4100-ba14-6deb3a969d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:31.920909 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1e203-46d8-4100-ba14-6deb3a969d8f None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:31.921271 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1e203-46d8-4100-ba14-6deb3a969d8f None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:31.921554 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1e203-46d8-4100-ba14-6deb3a969d8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:31.929658 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1e203-46d8-4100-ba14-6deb3a969d8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:31.931382 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1e203-46d8-4100-ba14-6deb3a969d8f None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:31.946847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-68d1e203-46d8-4100-ba14-6deb3a969d8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:31.946847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:31.946847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:31.946847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:31.946847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:31.946847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:31.946847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:31.946847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:31.946847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:31.946847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:31.946847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:31.946847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:31.946847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:44:31.946847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:44:31.946847 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:44:31.947883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:44:31.947883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:31.947883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:31.947883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:31.947883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:31.947883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:31.947883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:31.947883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:31.947883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:31.947883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:31.947883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:31.947883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:31.947883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:31.947883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:31.947883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:31.947883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:31.947883 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:31.948796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:44:31.948796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:44:31.948796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:44:31.948796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:44:31.948796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:44:31.948796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:44:31.948796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:31.948796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:31.948796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 294/578] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:31.956170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1e203-46d8-4100-ba14-6deb3a969d8f None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:32.025022 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f37a6-2734-47b5-9dc5-d5ee70ade28e None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:32.063212 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2395783-33f0-46cc-9b80-709ae5ea2e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:32.064504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2395783-33f0-46cc-9b80-709ae5ea2e78 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:32.064796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1e203-46d8-4100-ba14-6deb3a969d8f None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:32.065228 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2395783-33f0-46cc-9b80-709ae5ea2e78 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:32.065702 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2395783-33f0-46cc-9b80-709ae5ea2e78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:32.075687 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2395783-33f0-46cc-9b80-709ae5ea2e78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:32.078184 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2395783-33f0-46cc-9b80-709ae5ea2e78 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:32.100418 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c370a5d-9d54-418e-bd14-c440574ea6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:32.101019 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370a5d-9d54-418e-bd14-c440574ea6a6 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:32.101600 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370a5d-9d54-418e-bd14-c440574ea6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:32.101600 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370a5d-9d54-418e-bd14-c440574ea6a6 None admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:32.102335 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c370a5d-9d54-418e-bd14-c440574ea6a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:32.102757 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c370a5d-9d54-418e-bd14-c440574ea6a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:32.102934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-a2395783-33f0-46cc-9b80-709ae5ea2e78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:32.102934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:32.102934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:32.102934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:32.102934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:32.102934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:32.102934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:32.102934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:32.102934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:32.102934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:32.102934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:32.102934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:32.102934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:44:32.102934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:44:32.102934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:44:32.103769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:44:32.103769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:32.103769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:32.103769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:32.103769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:32.103769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:32.103769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:32.103769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:32.103769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:32.103769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:32.103769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:32.103769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:32.103769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:32.103769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:32.103769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:32.103769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:32.103769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:32.104702 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:44:32.104702 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:44:32.104702 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:44:32.104702 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:44:32.104702 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:44:32.104702 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:44:32.104702 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:32.104702 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:32.105129 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c370a5d-9d54-418e-bd14-c440574ea6a6 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:32.105209 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 285/579] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:32.113204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2395783-33f0-46cc-9b80-709ae5ea2e78 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:32.120149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 295/580] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:44:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:32.124298 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c370a5d-9d54-418e-bd14-c440574ea6a6 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:32.221206 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2395783-33f0-46cc-9b80-709ae5ea2e78 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:32.252193 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c370a5d-9d54-418e-bd14-c440574ea6a6 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:32.256749 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa998eb-c49a-47b5-a4e1-5825a7a915a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:32.257419 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa998eb-c49a-47b5-a4e1-5825a7a915a6 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:32.257703 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa998eb-c49a-47b5-a4e1-5825a7a915a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:32.258029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa998eb-c49a-47b5-a4e1-5825a7a915a6 None admin] PATH_INFO: `/v3/projects` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:32.258819 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa998eb-c49a-47b5-a4e1-5825a7a915a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:32.259128 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa998eb-c49a-47b5-a4e1-5825a7a915a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:32.260594 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa998eb-c49a-47b5-a4e1-5825a7a915a6 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:32.278703 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 286/581] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:44:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:32.279938 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa998eb-c49a-47b5-a4e1-5825a7a915a6 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:32.293270 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5843f41-fbb1-4f95-b338-58932aad0aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:32.294621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5843f41-fbb1-4f95-b338-58932aad0aed None admin] REQUEST_METHOD: `PUT` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:32.295613 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5843f41-fbb1-4f95-b338-58932aad0aed None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:32.296232 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5843f41-fbb1-4f95-b338-58932aad0aed None admin] PATH_INFO: `/v3/projects/758931ec3ed54a1eadf1b9a463fbb241/users/351c1af1091f4f97962da2c5e2d330d5/roles/78258bf52d1f4340bb3f7eda6a73f71a` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:32.316588 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5843f41-fbb1-4f95-b338-58932aad0aed None admin] RBAC: Authorizing `identity:create_grant(project_id=758931ec3ed54a1eadf1b9a463fbb241, user_id=351c1af1091f4f97962da2c5e2d330d5, role_id=78258bf52d1f4340bb3f7eda6a73f71a)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:32.321972 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5843f41-fbb1-4f95-b338-58932aad0aed None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:32.383227 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa998eb-c49a-47b5-a4e1-5825a7a915a6 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:32.418018 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7f825-e417-464d-b007-1d35dda7816c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:32.418966 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7f825-e417-464d-b007-1d35dda7816c None admin] REQUEST_METHOD: `PUT` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:32.419237 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7f825-e417-464d-b007-1d35dda7816c None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:32.419513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7f825-e417-464d-b007-1d35dda7816c None admin] PATH_INFO: `/v3/projects/758931ec3ed54a1eadf1b9a463fbb241/users/31e2b07c860d4316b35b1656f2f1c1aa/roles/78258bf52d1f4340bb3f7eda6a73f71a` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:32.434491 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7f825-e417-464d-b007-1d35dda7816c None admin] RBAC: Authorizing `identity:create_grant(project_id=758931ec3ed54a1eadf1b9a463fbb241, user_id=31e2b07c860d4316b35b1656f2f1c1aa, role_id=78258bf52d1f4340bb3f7eda6a73f71a)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:32.436809 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7f825-e417-464d-b007-1d35dda7816c None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:32.470856 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 296/582] 10.222.0.18 () {58 vars in 1439 bytes} [Mon May 2 08:44:32 2022] PUT /identity/v3/projects/758931ec3ed54a1eadf1b9a463fbb241/users/351c1af1091f4f97962da2c5e2d330d5/roles/78258bf52d1f4340bb3f7eda6a73f71a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 08:44:32.549959 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 287/583] 10.222.0.18 () {58 vars in 1439 bytes} [Mon May 2 08:44:32 2022] PUT /identity/v3/projects/758931ec3ed54a1eadf1b9a463fbb241/users/31e2b07c860d4316b35b1656f2f1c1aa/roles/78258bf52d1f4340bb3f7eda6a73f71a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 08:44:33.522081 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f0fff-59bf-47da-8f75-4e0f0343a53e None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:33.522661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f0fff-59bf-47da-8f75-4e0f0343a53e None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:33.522661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f0fff-59bf-47da-8f75-4e0f0343a53e None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:33.524226 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 297/584] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:33.529693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef5ba5-2dd7-4d81-8b47-c55117abb84b None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:33.530212 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef5ba5-2dd7-4d81-8b47-c55117abb84b None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:33.530310 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef5ba5-2dd7-4d81-8b47-c55117abb84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:33.547529 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-87ef5ba5-2dd7-4d81-8b47-c55117abb84b None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:33.548736 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-87ef5ba5-2dd7-4d81-8b47-c55117abb84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:33.616990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 288/585] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:33.641742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f0fff-59bf-47da-8f75-4e0f0343a53e None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:33.747396 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f0fff-59bf-47da-8f75-4e0f0343a53e None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:33.783662 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242844f-20b3-49d2-86df-70c3e2dc1ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:33.784828 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242844f-20b3-49d2-86df-70c3e2dc1ed0 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:33.785329 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242844f-20b3-49d2-86df-70c3e2dc1ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:33.785827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242844f-20b3-49d2-86df-70c3e2dc1ed0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:33.796972 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242844f-20b3-49d2-86df-70c3e2dc1ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:33.804784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-3242844f-20b3-49d2-86df-70c3e2dc1ed0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:33.804784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:33.804784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:33.804784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:33.804784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:33.804784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:33.804784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:33.804784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:33.804784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:33.804784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:33.804784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:33.804784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:33.804784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:33.804784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:33.804784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:33.804784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:33.805790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:33.805790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:33.805790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:33.805790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:33.805790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:33.805790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:33.805790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:33.805790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:33.805790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:33.805790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:33.805790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:33.805790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:33.805790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:33.805790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:33.805790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:33.805790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:33.806630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:33.806630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:33.806630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:33.806630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:33.806630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:33.806630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:33.806630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:33.806630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:33.806630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:33.806630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:33.806630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:33.806630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:33.809325 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 298/586] 10.222.0.18 () {56 vars in 1102 bytes} [Mon May 2 08:44:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:33.815219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef5ba5-2dd7-4d81-8b47-c55117abb84b None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:33.914168 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef5ba5-2dd7-4d81-8b47-c55117abb84b None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:33.947840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30181b04-6835-4806-9703-20f199621f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:33.948856 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30181b04-6835-4806-9703-20f199621f93 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:33.949365 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30181b04-6835-4806-9703-20f199621f93 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:33.949846 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30181b04-6835-4806-9703-20f199621f93 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:33.950785 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30181b04-6835-4806-9703-20f199621f93 None admin] RBAC: Adding query filter params (name=service) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:33.951924 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30181b04-6835-4806-9703-20f199621f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:33.953530 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30181b04-6835-4806-9703-20f199621f93 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:33.962085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 289/587] 10.222.0.18 () {56 vars in 1103 bytes} [Mon May 2 08:44:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:33.968363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242844f-20b3-49d2-86df-70c3e2dc1ed0 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:34.068381 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242844f-20b3-49d2-86df-70c3e2dc1ed0 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:34.107410 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cb864-5f22-46d6-884b-15f632f3380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:34.108432 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cb864-5f22-46d6-884b-15f632f3380e None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:34.108717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cb864-5f22-46d6-884b-15f632f3380e None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:34.108985 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cb864-5f22-46d6-884b-15f632f3380e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:34.120326 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cb864-5f22-46d6-884b-15f632f3380e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:34.121774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cb864-5f22-46d6-884b-15f632f3380e None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:34.139654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-3d4cb864-5f22-46d6-884b-15f632f3380e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:34.139654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:34.139654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:34.139654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:34.139654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:34.139654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:34.139654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:34.139654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:34.139654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:34.139654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:34.139654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:34.139654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:34.139654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:34.139654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:34.139654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:34.140671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:34.140671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:34.140671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:34.140671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:34.140671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:34.140671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:34.140671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:34.140671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:34.140671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:34.140671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:34.140671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:34.140671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:34.140671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:34.140671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:34.140671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:34.140671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:34.140671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:34.141558 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:34.141558 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:34.141558 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:34.141558 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:34.141558 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 299/588] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:34.147766 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30181b04-6835-4806-9703-20f199621f93 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:34.249190 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30181b04-6835-4806-9703-20f199621f93 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:34.269971 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c991f9b-7374-405e-8320-a35ed6dc6557 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:34.270304 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c991f9b-7374-405e-8320-a35ed6dc6557 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:34.270531 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c991f9b-7374-405e-8320-a35ed6dc6557 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:34.272195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 300/589] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:34.277343 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11656c2b-4ee3-4262-979e-43d7b02b02c3 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:34.277599 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11656c2b-4ee3-4262-979e-43d7b02b02c3 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:34.277879 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11656c2b-4ee3-4262-979e-43d7b02b02c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:34.285703 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f076c6b-edda-475b-89d2-4ef0effc9cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:34.286644 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f076c6b-edda-475b-89d2-4ef0effc9cca None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:34.287144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f076c6b-edda-475b-89d2-4ef0effc9cca None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:34.287632 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f076c6b-edda-475b-89d2-4ef0effc9cca None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:34.288596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f076c6b-edda-475b-89d2-4ef0effc9cca None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:34.289116 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f076c6b-edda-475b-89d2-4ef0effc9cca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:34.290699 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f076c6b-edda-475b-89d2-4ef0effc9cca None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:34.295179 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-11656c2b-4ee3-4262-979e-43d7b02b02c3 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:34.296413 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-11656c2b-4ee3-4262-979e-43d7b02b02c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:34.308084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 290/590] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:34.309174 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f076c6b-edda-475b-89d2-4ef0effc9cca None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:34.367667 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 301/591] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:44:34.393853 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11656c2b-4ee3-4262-979e-43d7b02b02c3 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:34.428084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f076c6b-edda-475b-89d2-4ef0effc9cca None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:34.471247 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bc87b-fff4-4bf5-87ae-d46dc06f533f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:34.472735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bc87b-fff4-4bf5-87ae-d46dc06f533f None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:34.473507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bc87b-fff4-4bf5-87ae-d46dc06f533f None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:34.474130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bc87b-fff4-4bf5-87ae-d46dc06f533f None admin] PATH_INFO: `/v3/users/nova` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:34.484250 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74bc87b-fff4-4bf5-87ae-d46dc06f533f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:34.486292 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74bc87b-fff4-4bf5-87ae-d46dc06f533f None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:34.496012 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11656c2b-4ee3-4262-979e-43d7b02b02c3 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:34.505202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-c74bc87b-fff4-4bf5-87ae-d46dc06f533f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 02 08:44:34.505202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:34.505202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:34.505202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:34.505202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:34.505202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:34.505202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:34.505202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:34.505202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:34.505202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:34.505202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:34.505202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:34.505202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:44:34.505202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:44:34.505202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:44:34.505202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:44:34.506394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:34.506394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:34.506394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:44:34.506394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:34.506394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:44:34.506394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:34.506394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:34.506394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:34.506394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:34.506394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:34.506394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:34.506394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:34.506394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:34.506394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:34.506394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:34.506394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:34.506394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:34.506394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:34.507582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:34.507582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:34.507582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:44:34.507582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:44:34.507582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:44:34.507582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:44:34.507582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:44:34.507582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:44:34.507582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 02 08:44:34.507582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:34.515682 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 291/592] 10.222.0.18 () {56 vars in 1093 bytes} [Mon May 2 08:44:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:34.516878 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bc87b-fff4-4bf5-87ae-d46dc06f533f None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:34.539369 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24874f-0f68-40d1-af09-caac75d74385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:34.540715 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24874f-0f68-40d1-af09-caac75d74385 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:34.540855 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24874f-0f68-40d1-af09-caac75d74385 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:34.541194 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24874f-0f68-40d1-af09-caac75d74385 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:34.552787 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24874f-0f68-40d1-af09-caac75d74385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:34.561176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-4b24874f-0f68-40d1-af09-caac75d74385 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:34.561176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:34.561176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:34.561176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:34.561176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:34.561176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:34.561176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:34.561176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:34.561176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:34.561176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:34.561176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:34.561176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:34.561176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:34.561176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:34.561176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:34.561176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:34.562182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:34.562182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:34.562182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:34.562182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:34.562182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:34.562182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:34.562182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:34.562182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:34.562182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:34.562182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:34.562182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:34.562182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:34.562182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:34.562182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:34.562182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:34.562182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:34.563013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:34.563013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:34.563013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:34.563013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:34.563013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:34.563013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:34.563013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:34.563013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:34.563013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:34.563013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:34.563013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:34.563013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:34.567532 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 302/593] 10.222.0.18 () {56 vars in 1102 bytes} [Mon May 2 08:44:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:34.568951 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24874f-0f68-40d1-af09-caac75d74385 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:34.624323 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bc87b-fff4-4bf5-87ae-d46dc06f533f None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:34.659152 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb8226-7d88-450e-ba14-a963da3c5b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:34.660264 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb8226-7d88-450e-ba14-a963da3c5b1a None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:34.660752 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb8226-7d88-450e-ba14-a963da3c5b1a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:34.661227 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb8226-7d88-450e-ba14-a963da3c5b1a None admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:34.662274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb8226-7d88-450e-ba14-a963da3c5b1a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:34.662810 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb8226-7d88-450e-ba14-a963da3c5b1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:34.664472 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb8226-7d88-450e-ba14-a963da3c5b1a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:34.677199 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24874f-0f68-40d1-af09-caac75d74385 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:34.687435 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 292/594] 10.222.0.18 () {56 vars in 1133 bytes} [Mon May 2 08:44:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:34.688505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb8226-7d88-450e-ba14-a963da3c5b1a None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:34.713320 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e0955-86f8-4777-94e3-7f6d91c2cdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:34.714045 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e0955-86f8-4777-94e3-7f6d91c2cdb6 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:34.715312 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e0955-86f8-4777-94e3-7f6d91c2cdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:34.715312 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e0955-86f8-4777-94e3-7f6d91c2cdb6 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:34.715502 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e0955-86f8-4777-94e3-7f6d91c2cdb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:34.715765 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e0955-86f8-4777-94e3-7f6d91c2cdb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:34.718164 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e0955-86f8-4777-94e3-7f6d91c2cdb6 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:34.727983 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 303/595] 10.222.0.18 () {56 vars in 1103 bytes} [Mon May 2 08:44:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:34.734988 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e0955-86f8-4777-94e3-7f6d91c2cdb6 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:34.795818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb8226-7d88-450e-ba14-a963da3c5b1a None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:34.830491 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f66de-36b1-4cd5-a510-17fb006daa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:34.831176 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f66de-36b1-4cd5-a510-17fb006daa82 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:34.831456 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f66de-36b1-4cd5-a510-17fb006daa82 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:34.831731 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f66de-36b1-4cd5-a510-17fb006daa82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:34.847286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e0955-86f8-4777-94e3-7f6d91c2cdb6 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:34.881955 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4928bd5-f0f7-4b7d-8012-29453befdc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:34.882675 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4928bd5-f0f7-4b7d-8012-29453befdc21 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:34.882958 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4928bd5-f0f7-4b7d-8012-29453befdc21 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:34.883291 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4928bd5-f0f7-4b7d-8012-29453befdc21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:34.895077 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4928bd5-f0f7-4b7d-8012-29453befdc21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:34.896573 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4928bd5-f0f7-4b7d-8012-29453befdc21 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:34.900402 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f66de-36b1-4cd5-a510-17fb006daa82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:34.901846 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f66de-36b1-4cd5-a510-17fb006daa82 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:34.914795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-c4928bd5-f0f7-4b7d-8012-29453befdc21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:34.914795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:34.914795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:34.914795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:34.914795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:34.914795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:34.914795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:34.914795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:34.914795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:34.914795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:34.914795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:34.914795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:34.914795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:34.914795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:34.914795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:34.916929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:34.916929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:34.916929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:34.916929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:34.916929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:34.916929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:34.916929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:34.916929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:34.916929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:34.916929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:34.916929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:34.916929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:34.916929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:34.916929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:34.916929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:34.916929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:34.916929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:34.919114 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:34.919114 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:34.919114 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:34.919114 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:34.925051 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 304/596] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:34.925051 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4928bd5-f0f7-4b7d-8012-29453befdc21 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:34.995420 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 293/597] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:44:34.996757 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0ff29-4aa4-4267-9384-f87d910cffef None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:34.997039 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0ff29-4aa4-4267-9384-f87d910cffef None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:34.997311 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0ff29-4aa4-4267-9384-f87d910cffef None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:35.001492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 294/598] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:35.001492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7fd64-27fb-4207-b2e3-e4d55947182c None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:35.001492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7fd64-27fb-4207-b2e3-e4d55947182c None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:35.001492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7fd64-27fb-4207-b2e3-e4d55947182c None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:35.003075 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 295/599] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:35.003464 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7fd64-27fb-4207-b2e3-e4d55947182c None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:35.020170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4928bd5-f0f7-4b7d-8012-29453befdc21 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:35.051777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa080f52-0ac1-4931-9032-935f36da1cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:35.052463 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa080f52-0ac1-4931-9032-935f36da1cf4 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:35.052745 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa080f52-0ac1-4931-9032-935f36da1cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:35.053019 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa080f52-0ac1-4931-9032-935f36da1cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:35.053729 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa080f52-0ac1-4931-9032-935f36da1cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:35.054033 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa080f52-0ac1-4931-9032-935f36da1cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:35.055404 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa080f52-0ac1-4931-9032-935f36da1cf4 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:35.067140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 305/600] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:35.068400 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779a2d8-57db-4cb3-b133-86650eb2d018 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:35.068690 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779a2d8-57db-4cb3-b133-86650eb2d018 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:35.068965 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779a2d8-57db-4cb3-b133-86650eb2d018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:35.085056 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-7779a2d8-57db-4cb3-b133-86650eb2d018 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:35.086224 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-7779a2d8-57db-4cb3-b133-86650eb2d018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:35.097474 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7fd64-27fb-4207-b2e3-e4d55947182c None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:35.130778 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859ecee-6fe6-4a52-80c0-983f7f919a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:35.131559 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859ecee-6fe6-4a52-80c0-983f7f919a5d None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:35.131834 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859ecee-6fe6-4a52-80c0-983f7f919a5d None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:35.132175 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859ecee-6fe6-4a52-80c0-983f7f919a5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:35.141988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859ecee-6fe6-4a52-80c0-983f7f919a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:35.143441 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859ecee-6fe6-4a52-80c0-983f7f919a5d None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:35.149239 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 306/601] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:35.150496 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d05e23-097c-4493-b282-9b3a6232f9e0 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:35.150785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d05e23-097c-4493-b282-9b3a6232f9e0 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:35.151055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d05e23-097c-4493-b282-9b3a6232f9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:35.160840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-d859ecee-6fe6-4a52-80c0-983f7f919a5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:35.160840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:35.160840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:35.160840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:35.160840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:35.160840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:35.160840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:35.160840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:35.160840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:35.160840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:35.160840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:35.160840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:35.160840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:35.160840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:35.160840 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:35.161715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:35.161715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:35.161715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:35.161715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:35.161715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:35.161715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:35.161715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:35.161715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:35.161715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:35.161715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:35.161715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:35.161715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:35.161715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:35.161715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:35.161715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:35.161715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:35.161715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:35.162616 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:35.162616 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:35.162616 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:35.162616 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:35.162616 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 296/602] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:35.162890 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859ecee-6fe6-4a52-80c0-983f7f919a5d None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:35.170895 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-e7d05e23-097c-4493-b282-9b3a6232f9e0 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:35.172152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-e7d05e23-097c-4493-b282-9b3a6232f9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:35.235278 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 307/603] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:35.236144 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d05e23-097c-4493-b282-9b3a6232f9e0 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:35.256931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859ecee-6fe6-4a52-80c0-983f7f919a5d None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:35.288352 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059ee2b-932f-464a-a6e2-068b22b76c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:35.289140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059ee2b-932f-464a-a6e2-068b22b76c1d None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:35.289416 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059ee2b-932f-464a-a6e2-068b22b76c1d None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:35.289684 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059ee2b-932f-464a-a6e2-068b22b76c1d None admin] PATH_INFO: `/v3/users/glance` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:35.296948 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059ee2b-932f-464a-a6e2-068b22b76c1d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:35.298382 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059ee2b-932f-464a-a6e2-068b22b76c1d None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:35.312395 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-2059ee2b-932f-464a-a6e2-068b22b76c1d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 02 08:44:35.312395 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:35.312395 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:35.312395 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:35.312395 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:35.312395 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:35.312395 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:35.312395 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:35.312395 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:35.312395 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:35.312395 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:35.312395 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:35.312395 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:44:35.312395 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:44:35.312395 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:44:35.312395 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:44:35.313518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:35.313518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:35.313518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:44:35.313518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:35.313518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:44:35.313518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:35.313518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:35.313518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:35.313518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:35.313518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:35.313518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:35.313518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:35.313518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:35.313518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:35.313518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:35.313518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:35.313518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:35.313518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:35.314877 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:35.314877 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:35.314877 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:44:35.314877 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:44:35.314877 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:44:35.314877 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:44:35.314877 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:44:35.314877 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:44:35.314877 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 02 08:44:35.314877 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:35.314877 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 297/604] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:35.314877 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059ee2b-932f-464a-a6e2-068b22b76c1d None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:35.335242 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d05e23-097c-4493-b282-9b3a6232f9e0 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:35.367284 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28e6e4-02fb-4b33-857f-55c8641184e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:35.367939 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28e6e4-02fb-4b33-857f-55c8641184e5 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:35.368255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28e6e4-02fb-4b33-857f-55c8641184e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:35.368534 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28e6e4-02fb-4b33-857f-55c8641184e5 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:35.369248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28e6e4-02fb-4b33-857f-55c8641184e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:35.369554 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28e6e4-02fb-4b33-857f-55c8641184e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:35.370931 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28e6e4-02fb-4b33-857f-55c8641184e5 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:35.386179 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 308/605] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:35.386179 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28e6e4-02fb-4b33-857f-55c8641184e5 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:35.408109 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059ee2b-932f-464a-a6e2-068b22b76c1d None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:35.440439 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52aa42-cba3-47c3-9849-240b8805a761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:35.441236 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52aa42-cba3-47c3-9849-240b8805a761 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:35.441514 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52aa42-cba3-47c3-9849-240b8805a761 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:35.441783 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52aa42-cba3-47c3-9849-240b8805a761 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:35.451589 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52aa42-cba3-47c3-9849-240b8805a761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:35.459239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-6a52aa42-cba3-47c3-9849-240b8805a761 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:35.459239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:35.459239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:35.459239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:35.459239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:35.459239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:35.459239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:35.459239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:35.459239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:35.459239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:35.459239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:35.459239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:35.459239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:35.459239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:35.459239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:35.459239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:35.460219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:35.460219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:35.460219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:35.460219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:35.460219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:35.460219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:35.460219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:35.460219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:35.460219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:35.460219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:35.460219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:35.460219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:35.460219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:35.460219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:35.460219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:35.460219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:35.461097 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:35.461097 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:35.461097 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:35.461097 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:35.461097 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:35.461097 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:35.461097 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:35.461097 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:35.461097 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:35.461097 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:35.461097 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:35.461097 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:35.461097 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 298/606] 10.222.0.18 () {56 vars in 1102 bytes} [Mon May 2 08:44:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:35.461783 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52aa42-cba3-47c3-9849-240b8805a761 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:35.481589 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28e6e4-02fb-4b33-857f-55c8641184e5 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:35.513312 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f014a9-f34a-479e-9eaf-e173f21e4a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:35.514337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f014a9-f34a-479e-9eaf-e173f21e4a8d None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:35.514618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f014a9-f34a-479e-9eaf-e173f21e4a8d None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:35.514891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f014a9-f34a-479e-9eaf-e173f21e4a8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:35.524589 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f014a9-f34a-479e-9eaf-e173f21e4a8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:35.532827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-10f014a9-f34a-479e-9eaf-e173f21e4a8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:35.532827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:35.532827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:35.532827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:35.532827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:35.532827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:35.532827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:35.532827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:35.532827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:35.532827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:35.532827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:35.532827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:35.532827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:35.532827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:35.532827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:35.532827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:35.533752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:35.533752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:35.533752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:35.533752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:35.533752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:35.533752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:35.533752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:35.533752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:35.533752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:35.533752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:35.533752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:35.533752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:35.533752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:35.533752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:35.533752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:35.533752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:35.534596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:35.534596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:35.534596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:35.534596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:35.534596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:35.534596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:35.534596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:35.534596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:35.534596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:35.534596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:35.534596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 08:44:35.534596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:35.534596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 309/607] 10.222.0.18 () {56 vars in 1102 bytes} [Mon May 2 08:44:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:35.535290 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f014a9-f34a-479e-9eaf-e173f21e4a8d None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:35.554638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52aa42-cba3-47c3-9849-240b8805a761 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:35.585563 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0d318-b8cb-4b40-a94c-422e036577ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:35.586224 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0d318-b8cb-4b40-a94c-422e036577ee None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:35.586506 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0d318-b8cb-4b40-a94c-422e036577ee None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:35.586778 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0d318-b8cb-4b40-a94c-422e036577ee None admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:35.587592 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0d318-b8cb-4b40-a94c-422e036577ee None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:35.587897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0d318-b8cb-4b40-a94c-422e036577ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:35.589354 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0d318-b8cb-4b40-a94c-422e036577ee None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:35.605812 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 299/608] 10.222.0.18 () {56 vars in 1137 bytes} [Mon May 2 08:44:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:35.606597 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0d318-b8cb-4b40-a94c-422e036577ee None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:35.629309 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f014a9-f34a-479e-9eaf-e173f21e4a8d None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:35.663369 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538cbbd-3d44-4f65-8de1-cb59d68419dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:35.664187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538cbbd-3d44-4f65-8de1-cb59d68419dd None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:35.664466 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538cbbd-3d44-4f65-8de1-cb59d68419dd None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:35.664737 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538cbbd-3d44-4f65-8de1-cb59d68419dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:35.672113 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538cbbd-3d44-4f65-8de1-cb59d68419dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:35.673565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538cbbd-3d44-4f65-8de1-cb59d68419dd None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:35.687307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-4538cbbd-3d44-4f65-8de1-cb59d68419dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:35.687307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:35.687307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:35.687307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:35.687307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:35.687307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:35.687307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:35.687307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:35.687307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:35.687307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:35.687307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:35.687307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:35.687307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:44:35.687307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:44:35.687307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:44:35.688442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:44:35.688442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:35.688442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:35.688442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:35.688442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:35.688442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:35.688442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:35.688442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:35.688442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:35.688442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:35.688442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:35.688442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:35.688442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:35.688442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:35.688442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:35.688442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:35.688442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:35.689430 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:44:35.689430 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:44:35.689430 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:44:35.689430 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:44:35.689430 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:44:35.689430 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:44:35.689430 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:35.689430 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:35.689430 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 310/609] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:35.690078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538cbbd-3d44-4f65-8de1-cb59d68419dd None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:35.704222 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0d318-b8cb-4b40-a94c-422e036577ee None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:35.736286 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761221f-4a3a-4af0-9fee-a4d96ae3bf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:35.736945 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761221f-4a3a-4af0-9fee-a4d96ae3bf3d None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:35.737225 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761221f-4a3a-4af0-9fee-a4d96ae3bf3d None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:35.737498 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761221f-4a3a-4af0-9fee-a4d96ae3bf3d None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:35.738228 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761221f-4a3a-4af0-9fee-a4d96ae3bf3d None admin] RBAC: Adding query filter params (name=service) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:35.738533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761221f-4a3a-4af0-9fee-a4d96ae3bf3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:35.739907 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761221f-4a3a-4af0-9fee-a4d96ae3bf3d None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:35.747416 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 300/610] 10.222.0.18 () {56 vars in 1103 bytes} [Mon May 2 08:44:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:35.748225 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761221f-4a3a-4af0-9fee-a4d96ae3bf3d None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:35.787902 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538cbbd-3d44-4f65-8de1-cb59d68419dd None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:35.820572 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f14d2-1050-4a37-ab66-02eafacb4fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:35.821227 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f14d2-1050-4a37-ab66-02eafacb4fe7 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:35.821515 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f14d2-1050-4a37-ab66-02eafacb4fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:35.822051 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f14d2-1050-4a37-ab66-02eafacb4fe7 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:35.822822 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f14d2-1050-4a37-ab66-02eafacb4fe7 None admin] RBAC: Adding query filter params (name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:35.823135 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f14d2-1050-4a37-ab66-02eafacb4fe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:35.824587 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f14d2-1050-4a37-ab66-02eafacb4fe7 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:35.833063 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 311/611] 10.222.0.18 () {56 vars in 1103 bytes} [Mon May 2 08:44:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:35.833855 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f14d2-1050-4a37-ab66-02eafacb4fe7 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:35.842734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761221f-4a3a-4af0-9fee-a4d96ae3bf3d None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:35.874881 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186ecce-f255-4ec5-afe5-127346c19441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:35.875516 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186ecce-f255-4ec5-afe5-127346c19441 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:35.875794 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186ecce-f255-4ec5-afe5-127346c19441 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:35.876091 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186ecce-f255-4ec5-afe5-127346c19441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:35.935089 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f14d2-1050-4a37-ab66-02eafacb4fe7 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:35.938820 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186ecce-f255-4ec5-afe5-127346c19441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:35.940321 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186ecce-f255-4ec5-afe5-127346c19441 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:35.967395 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b090c58-25d9-4618-93b1-52fd1023846d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:35.968173 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b090c58-25d9-4618-93b1-52fd1023846d None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:35.968466 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b090c58-25d9-4618-93b1-52fd1023846d None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:35.968770 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b090c58-25d9-4618-93b1-52fd1023846d None admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:35.969555 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b090c58-25d9-4618-93b1-52fd1023846d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:35.969942 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b090c58-25d9-4618-93b1-52fd1023846d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:35.971422 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b090c58-25d9-4618-93b1-52fd1023846d None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:35.983560 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 312/612] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:44:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:35.984378 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b090c58-25d9-4618-93b1-52fd1023846d None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:36.039106 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 301/613] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:44:36.040085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186ecce-f255-4ec5-afe5-127346c19441 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:36.078469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b090c58-25d9-4618-93b1-52fd1023846d None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:36.110319 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc8e07-71f5-439f-a666-2e7a9d7af1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:36.111128 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc8e07-71f5-439f-a666-2e7a9d7af1a1 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:36.111404 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc8e07-71f5-439f-a666-2e7a9d7af1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:36.111673 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc8e07-71f5-439f-a666-2e7a9d7af1a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:36.121178 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc8e07-71f5-439f-a666-2e7a9d7af1a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:36.122601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc8e07-71f5-439f-a666-2e7a9d7af1a1 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:36.132505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186ecce-f255-4ec5-afe5-127346c19441 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:36.140082 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-f3bc8e07-71f5-439f-a666-2e7a9d7af1a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:36.140082 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:36.140082 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:36.140082 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:36.140082 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:36.140082 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:36.140082 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:36.140082 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:36.140082 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:36.140082 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:36.140082 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:36.140082 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:36.140082 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:36.140082 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:36.140082 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:36.141117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:36.141117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:36.141117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:36.141117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:36.141117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:36.141117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:36.141117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:36.141117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:36.141117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:36.141117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:36.141117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:36.141117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:36.141117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:36.141117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:36.141117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:36.141117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:36.141117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:36.142016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:36.142016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:36.142016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:36.142016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:36.142016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 313/614] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:36.142422 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc8e07-71f5-439f-a666-2e7a9d7af1a1 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:36.167759 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835b9a4-8a93-49d0-9d0b-6db2ca984f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:36.168583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835b9a4-8a93-49d0-9d0b-6db2ca984f92 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:36.168868 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835b9a4-8a93-49d0-9d0b-6db2ca984f92 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:36.169140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835b9a4-8a93-49d0-9d0b-6db2ca984f92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:36.178989 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835b9a4-8a93-49d0-9d0b-6db2ca984f92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:36.180494 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835b9a4-8a93-49d0-9d0b-6db2ca984f92 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:36.198274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-b835b9a4-8a93-49d0-9d0b-6db2ca984f92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:36.198274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:36.198274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:36.198274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:36.198274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:36.198274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:36.198274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:36.198274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:36.198274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:36.198274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:36.198274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:36.198274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:36.198274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:36.198274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:36.198274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:36.199140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:36.199140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:36.199140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:36.199140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:36.199140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:36.199140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:36.199140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:36.199140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:36.199140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:36.199140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:36.199140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:36.199140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:36.199140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:36.199140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:36.199140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:36.199140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:36.199140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:36.205146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:36.205146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:36.205146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:36.205146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:36.205146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 302/615] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:36.205146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835b9a4-8a93-49d0-9d0b-6db2ca984f92 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:36.236249 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc8e07-71f5-439f-a666-2e7a9d7af1a1 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:36.268314 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5e7c7-76c4-4800-8d67-9636a1229076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:36.268957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5e7c7-76c4-4800-8d67-9636a1229076 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:36.269238 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5e7c7-76c4-4800-8d67-9636a1229076 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:36.269511 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5e7c7-76c4-4800-8d67-9636a1229076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:36.270348 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5e7c7-76c4-4800-8d67-9636a1229076 None admin] RBAC: Adding query filter params (role.id=78258bf52d1f4340bb3f7eda6a73f71a, scope.project.id=758931ec3ed54a1eadf1b9a463fbb241, user.id=97308967556844019594cd0c4abc41fc) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:36.270654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5e7c7-76c4-4800-8d67-9636a1229076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:36.272100 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5e7c7-76c4-4800-8d67-9636a1229076 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:36.277656 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 314/616] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:44:36 2022] GET /identity/v3/role_assignments?user.id=97308967556844019594cd0c4abc41fc&scope.project.id=758931ec3ed54a1eadf1b9a463fbb241&role.id=78258bf52d1f4340bb3f7eda6a73f71a => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:36.278426 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5e7c7-76c4-4800-8d67-9636a1229076 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:36.296012 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835b9a4-8a93-49d0-9d0b-6db2ca984f92 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:36.360367 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7205fdd-84c2-4070-a3d9-b5bdb95d47b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:36.360367 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7205fdd-84c2-4070-a3d9-b5bdb95d47b0 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:36.360367 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7205fdd-84c2-4070-a3d9-b5bdb95d47b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:36.360367 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7205fdd-84c2-4070-a3d9-b5bdb95d47b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:36.360779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7205fdd-84c2-4070-a3d9-b5bdb95d47b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:36.360779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7205fdd-84c2-4070-a3d9-b5bdb95d47b0 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:36.367135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-a7205fdd-84c2-4070-a3d9-b5bdb95d47b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:36.367135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:36.367135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:36.367135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:36.367135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:36.367135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:36.367135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:36.367135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:36.367135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:36.367135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:36.367135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:36.367135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:36.367135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:36.367135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:36.367135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:36.368329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:36.368329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:36.368329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:36.368329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:36.368329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:36.368329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:36.368329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:36.368329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:36.368329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:36.368329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:36.368329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:36.368329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:36.368329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:36.368329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:36.368329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:36.368329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:36.368329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:36.369288 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:36.369288 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:36.369288 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:36.369288 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:36.369288 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 303/617] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:36.369288 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7205fdd-84c2-4070-a3d9-b5bdb95d47b0 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:36.392649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5e7c7-76c4-4800-8d67-9636a1229076 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:36.428183 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d4f00-6ab9-4082-b172-6aac0349e5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:36.428959 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d4f00-6ab9-4082-b172-6aac0349e5b9 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:36.429244 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d4f00-6ab9-4082-b172-6aac0349e5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:36.429517 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d4f00-6ab9-4082-b172-6aac0349e5b9 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:36.430256 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d4f00-6ab9-4082-b172-6aac0349e5b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:36.430564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d4f00-6ab9-4082-b172-6aac0349e5b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:36.432080 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d4f00-6ab9-4082-b172-6aac0349e5b9 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:36.445200 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 315/618] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:36.446210 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d4f00-6ab9-4082-b172-6aac0349e5b9 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:36.480981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7205fdd-84c2-4070-a3d9-b5bdb95d47b0 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:36.516688 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f739f-c693-4eb3-ae06-54a8f05e816d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:36.517355 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f739f-c693-4eb3-ae06-54a8f05e816d None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:36.517638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f739f-c693-4eb3-ae06-54a8f05e816d None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:36.517913 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f739f-c693-4eb3-ae06-54a8f05e816d None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:36.518646 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f739f-c693-4eb3-ae06-54a8f05e816d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:36.518937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f739f-c693-4eb3-ae06-54a8f05e816d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:36.520436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f739f-c693-4eb3-ae06-54a8f05e816d None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:36.533335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 304/619] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:36.534194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f739f-c693-4eb3-ae06-54a8f05e816d None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:36.560622 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d4f00-6ab9-4082-b172-6aac0349e5b9 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:36.594455 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66298dc8-589c-4c28-877b-7941f1a5958a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:36.595065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66298dc8-589c-4c28-877b-7941f1a5958a None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:36.595358 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66298dc8-589c-4c28-877b-7941f1a5958a None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:36.595625 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66298dc8-589c-4c28-877b-7941f1a5958a None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:36.596369 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66298dc8-589c-4c28-877b-7941f1a5958a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:36.596671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66298dc8-589c-4c28-877b-7941f1a5958a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:36.598042 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66298dc8-589c-4c28-877b-7941f1a5958a None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:36.615123 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 316/620] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:36.615123 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66298dc8-589c-4c28-877b-7941f1a5958a None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:36.638105 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f739f-c693-4eb3-ae06-54a8f05e816d None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:36.673636 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad3850-10d9-43fd-a543-1ea6120c60ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:36.674559 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad3850-10d9-43fd-a543-1ea6120c60ac None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:36.674946 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad3850-10d9-43fd-a543-1ea6120c60ac None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:36.675321 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad3850-10d9-43fd-a543-1ea6120c60ac None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:36.682718 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad3850-10d9-43fd-a543-1ea6120c60ac None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:36.684311 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad3850-10d9-43fd-a543-1ea6120c60ac None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:36.699412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-44ad3850-10d9-43fd-a543-1ea6120c60ac None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 02 08:44:36.699412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:36.699412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:36.699412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:36.699412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:36.699412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:36.699412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:36.699412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:36.699412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:36.699412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:36.699412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:36.699412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:36.699412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:44:36.699412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:44:36.699412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:44:36.699412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:44:36.700680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:36.700680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:36.700680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:44:36.700680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:36.700680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:44:36.700680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:36.700680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:36.700680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:36.700680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:36.700680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:36.700680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:36.700680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:36.700680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:36.700680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:36.700680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:36.700680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:36.700680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:36.700680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:36.707602 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:36.707602 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:36.707602 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:44:36.707602 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:44:36.707602 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:44:36.707602 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:44:36.707602 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:44:36.707602 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:44:36.707602 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 02 08:44:36.707602 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:36.707602 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 305/621] 10.222.0.18 () {56 vars in 1102 bytes} [Mon May 2 08:44:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:36.707602 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad3850-10d9-43fd-a543-1ea6120c60ac None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:36.725872 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66298dc8-589c-4c28-877b-7941f1a5958a None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:36.758999 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce7e94-2aa9-4874-875f-39d3e9e86bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:36.759810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce7e94-2aa9-4874-875f-39d3e9e86bc4 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:36.760193 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce7e94-2aa9-4874-875f-39d3e9e86bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:36.760538 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce7e94-2aa9-4874-875f-39d3e9e86bc4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:36.768881 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce7e94-2aa9-4874-875f-39d3e9e86bc4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:36.770414 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce7e94-2aa9-4874-875f-39d3e9e86bc4 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:36.784252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-bdce7e94-2aa9-4874-875f-39d3e9e86bc4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 02 08:44:36.784252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:36.784252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:36.784252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:36.784252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:36.784252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:36.784252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:36.784252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:36.784252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:36.784252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:36.784252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:36.784252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:36.784252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:44:36.784252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:44:36.784252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:44:36.784252 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:44:36.785409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:36.785409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:36.785409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:44:36.785409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:36.785409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:44:36.785409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:36.785409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:36.785409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:36.785409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:36.785409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:36.785409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:36.785409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:36.785409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:36.785409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:36.785409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:36.785409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:36.785409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:36.785409 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:36.786591 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:36.786591 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:36.786591 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:44:36.786591 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:44:36.786591 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:44:36.786591 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:44:36.786591 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:44:36.786591 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:44:36.786591 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 02 08:44:36.786591 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:36.787313 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 317/622] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:36.787313 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce7e94-2aa9-4874-875f-39d3e9e86bc4 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:36.809258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad3850-10d9-43fd-a543-1ea6120c60ac None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:36.844039 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bf81e-0af6-4384-ae6a-c413e32ad79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:36.844946 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bf81e-0af6-4384-ae6a-c413e32ad79a None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:36.845307 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bf81e-0af6-4384-ae6a-c413e32ad79a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:36.845692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bf81e-0af6-4384-ae6a-c413e32ad79a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:36.852306 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bf81e-0af6-4384-ae6a-c413e32ad79a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:36.853883 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bf81e-0af6-4384-ae6a-c413e32ad79a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:36.867842 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-c48bf81e-0af6-4384-ae6a-c413e32ad79a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:36.867842 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:36.867842 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:36.867842 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:36.867842 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:36.867842 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:36.867842 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:36.867842 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:36.867842 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:36.867842 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:36.867842 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:36.867842 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:36.867842 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:44:36.867842 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:44:36.867842 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:44:36.868972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:44:36.868972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:36.868972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:36.868972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:36.868972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:36.868972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:36.868972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:36.868972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:36.868972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:36.868972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:36.868972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:36.868972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:36.868972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:36.868972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:36.868972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:36.868972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:36.868972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:36.870110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:44:36.870110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:44:36.870110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:44:36.870110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:44:36.870110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:44:36.870110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:44:36.870110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:36.870110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:36.876968 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 306/623] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:36.876968 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bf81e-0af6-4384-ae6a-c413e32ad79a None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:36.885014 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce7e94-2aa9-4874-875f-39d3e9e86bc4 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:36.918876 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c49e47-809e-4797-ad2d-b7ada2469a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:36.919662 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c49e47-809e-4797-ad2d-b7ada2469a93 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:36.920226 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c49e47-809e-4797-ad2d-b7ada2469a93 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:36.920719 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c49e47-809e-4797-ad2d-b7ada2469a93 None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:36.921629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c49e47-809e-4797-ad2d-b7ada2469a93 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:36.922014 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c49e47-809e-4797-ad2d-b7ada2469a93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:36.923517 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c49e47-809e-4797-ad2d-b7ada2469a93 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:36.944934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 318/624] 10.222.0.18 () {56 vars in 1139 bytes} [Mon May 2 08:44:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:36.944934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c49e47-809e-4797-ad2d-b7ada2469a93 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:36.977311 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bf81e-0af6-4384-ae6a-c413e32ad79a None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:37.010846 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96871761-7da0-4896-834d-3595e1ea4acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:37.011533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96871761-7da0-4896-834d-3595e1ea4acb None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:37.011890 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96871761-7da0-4896-834d-3595e1ea4acb None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:37.012267 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96871761-7da0-4896-834d-3595e1ea4acb None admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:37.013167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96871761-7da0-4896-834d-3595e1ea4acb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:37.014321 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96871761-7da0-4896-834d-3595e1ea4acb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:37.016069 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96871761-7da0-4896-834d-3595e1ea4acb None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:37.037209 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 307/625] 10.222.0.18 () {56 vars in 1137 bytes} [Mon May 2 08:44:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:37.038010 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96871761-7da0-4896-834d-3595e1ea4acb None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:37.040198 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c49e47-809e-4797-ad2d-b7ada2469a93 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:37.076636 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec186a4-8325-4f6b-b545-92f92d4ce691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:37.077676 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec186a4-8325-4f6b-b545-92f92d4ce691 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:37.078060 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec186a4-8325-4f6b-b545-92f92d4ce691 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:37.078459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec186a4-8325-4f6b-b545-92f92d4ce691 None admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:37.079393 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec186a4-8325-4f6b-b545-92f92d4ce691 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:37.079805 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec186a4-8325-4f6b-b545-92f92d4ce691 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:37.081363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec186a4-8325-4f6b-b545-92f92d4ce691 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:37.098492 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 319/626] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:44:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:37.098492 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec186a4-8325-4f6b-b545-92f92d4ce691 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:37.139355 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96871761-7da0-4896-834d-3595e1ea4acb None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:37.173958 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a91e92-bfe1-4b83-926f-f96cbb1d41f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:37.174702 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a91e92-bfe1-4b83-926f-f96cbb1d41f9 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:37.175056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a91e92-bfe1-4b83-926f-f96cbb1d41f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:37.175410 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a91e92-bfe1-4b83-926f-f96cbb1d41f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:37.195089 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec186a4-8325-4f6b-b545-92f92d4ce691 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:37.229311 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec73c03-7b24-4acb-92fa-cd27406a609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:37.230103 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec73c03-7b24-4acb-92fa-cd27406a609a None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:37.230464 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec73c03-7b24-4acb-92fa-cd27406a609a None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:37.230796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec73c03-7b24-4acb-92fa-cd27406a609a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:37.244919 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a91e92-bfe1-4b83-926f-f96cbb1d41f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:37.246500 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a91e92-bfe1-4b83-926f-f96cbb1d41f9 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:37.299086 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec73c03-7b24-4acb-92fa-cd27406a609a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:37.300608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec73c03-7b24-4acb-92fa-cd27406a609a None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:37.348567 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 308/627] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:44:37.349673 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a91e92-bfe1-4b83-926f-f96cbb1d41f9 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:37.406021 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 320/628] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:44:37.406876 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec73c03-7b24-4acb-92fa-cd27406a609a None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:37.451974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a91e92-bfe1-4b83-926f-f96cbb1d41f9 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:37.487613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a50ea3-1d28-45e3-aca2-ca4188efd35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:37.488311 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a50ea3-1d28-45e3-aca2-ca4188efd35b None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:37.488593 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a50ea3-1d28-45e3-aca2-ca4188efd35b None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:37.488867 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a50ea3-1d28-45e3-aca2-ca4188efd35b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:37.489697 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a50ea3-1d28-45e3-aca2-ca4188efd35b None admin] RBAC: Adding query filter params (role.id=78258bf52d1f4340bb3f7eda6a73f71a, scope.project.id=758931ec3ed54a1eadf1b9a463fbb241, user.id=b1bb8a2281ef49be8b2501dd399bbfe4) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:37.490009 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a50ea3-1d28-45e3-aca2-ca4188efd35b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:37.491446 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a50ea3-1d28-45e3-aca2-ca4188efd35b None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:37.504392 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 309/629] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:44:37 2022] GET /identity/v3/role_assignments?user.id=b1bb8a2281ef49be8b2501dd399bbfe4&scope.project.id=758931ec3ed54a1eadf1b9a463fbb241&role.id=78258bf52d1f4340bb3f7eda6a73f71a => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:37.504392 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a50ea3-1d28-45e3-aca2-ca4188efd35b None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:37.516489 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec73c03-7b24-4acb-92fa-cd27406a609a None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:37.560770 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528f554-fb33-45bd-8d2f-95e9de1ec9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:37.561492 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528f554-fb33-45bd-8d2f-95e9de1ec9a1 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:37.561773 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528f554-fb33-45bd-8d2f-95e9de1ec9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:37.562051 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528f554-fb33-45bd-8d2f-95e9de1ec9a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:37.574150 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528f554-fb33-45bd-8d2f-95e9de1ec9a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:37.575653 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528f554-fb33-45bd-8d2f-95e9de1ec9a1 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:37.600195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-9528f554-fb33-45bd-8d2f-95e9de1ec9a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:37.600195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:37.600195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:37.600195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:37.600195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:37.600195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:37.600195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:37.600195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:37.600195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:37.600195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:37.600195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:37.600195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:37.600195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:37.600195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:37.600195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:37.601167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:37.601167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:37.601167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:37.601167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:37.601167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:37.601167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:37.601167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:37.601167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:37.601167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:37.601167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:37.601167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:37.601167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:37.601167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:37.601167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:37.601167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:37.601167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:37.601167 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:37.602061 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:37.602061 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:37.602061 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:37.602061 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:37.602061 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 321/630] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:37.608632 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528f554-fb33-45bd-8d2f-95e9de1ec9a1 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:37.611441 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a50ea3-1d28-45e3-aca2-ca4188efd35b None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:37.651750 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f474e3c-b727-45b6-b265-03b0221fee51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:37.652675 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f474e3c-b727-45b6-b265-03b0221fee51 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:37.653024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f474e3c-b727-45b6-b265-03b0221fee51 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:37.653298 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f474e3c-b727-45b6-b265-03b0221fee51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:37.671562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f474e3c-b727-45b6-b265-03b0221fee51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:37.673348 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f474e3c-b727-45b6-b265-03b0221fee51 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:37.691967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-6f474e3c-b727-45b6-b265-03b0221fee51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:37.691967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:37.691967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:37.691967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:37.691967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:37.691967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:37.691967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:37.691967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:37.691967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:37.691967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:37.691967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:37.691967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:37.691967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:37.691967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:37.691967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:37.693330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:37.693330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:37.693330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:37.693330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:37.693330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:37.693330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:37.693330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:37.693330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:37.693330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:37.693330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:37.693330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:37.693330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:37.693330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:37.693330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:37.693330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:37.693330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:37.693330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:37.694389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:37.694389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:37.694389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:37.694389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:37.695951 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 310/631] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:37.702641 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f474e3c-b727-45b6-b265-03b0221fee51 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:37.728927 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528f554-fb33-45bd-8d2f-95e9de1ec9a1 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:37.777122 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e8cb1-d91e-4b85-976b-0687e19ea3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:37.777877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e8cb1-d91e-4b85-976b-0687e19ea3d2 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:37.778072 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e8cb1-d91e-4b85-976b-0687e19ea3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:37.778353 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e8cb1-d91e-4b85-976b-0687e19ea3d2 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:37.779761 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e8cb1-d91e-4b85-976b-0687e19ea3d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:37.780387 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e8cb1-d91e-4b85-976b-0687e19ea3d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:37.781832 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e8cb1-d91e-4b85-976b-0687e19ea3d2 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:37.795095 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 322/632] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:37.801032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e8cb1-d91e-4b85-976b-0687e19ea3d2 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:37.836171 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f474e3c-b727-45b6-b265-03b0221fee51 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:37.879007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbb0cd-a11f-4298-b4a7-26e449b988bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:37.880073 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbb0cd-a11f-4298-b4a7-26e449b988bc None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:37.880432 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbb0cd-a11f-4298-b4a7-26e449b988bc None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:37.880798 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbb0cd-a11f-4298-b4a7-26e449b988bc None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:37.881765 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbb0cd-a11f-4298-b4a7-26e449b988bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:37.882916 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbb0cd-a11f-4298-b4a7-26e449b988bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:37.884466 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbb0cd-a11f-4298-b4a7-26e449b988bc None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:37.900308 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 311/633] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:37.909306 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbb0cd-a11f-4298-b4a7-26e449b988bc None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:37.934440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e8cb1-d91e-4b85-976b-0687e19ea3d2 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:37.979615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a2f0a-b577-458b-b9c7-bcd2ef41cac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:37.980595 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a2f0a-b577-458b-b9c7-bcd2ef41cac8 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:37.980881 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a2f0a-b577-458b-b9c7-bcd2ef41cac8 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:37.981475 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a2f0a-b577-458b-b9c7-bcd2ef41cac8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:37.990644 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a2f0a-b577-458b-b9c7-bcd2ef41cac8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:37.992598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a2f0a-b577-458b-b9c7-bcd2ef41cac8 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:38.009817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-3e4a2f0a-b577-458b-b9c7-bcd2ef41cac8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:38.009817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:38.009817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:38.009817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:38.009817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:38.009817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:38.009817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:38.009817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:38.009817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:38.009817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:38.009817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:38.009817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:38.009817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:44:38.009817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:44:38.009817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:44:38.010774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:44:38.010774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:38.010774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:38.010774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:38.010774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:38.010774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:38.010774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:38.010774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:38.010774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:38.010774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:38.010774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:38.010774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:38.010774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:38.010774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:38.010774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:38.010774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:38.010774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:38.011717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:44:38.011717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:44:38.011717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:44:38.011717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:44:38.011717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:44:38.011717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:44:38.011717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:38.011717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:38.011717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 323/634] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:38.019652 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a2f0a-b577-458b-b9c7-bcd2ef41cac8 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:38.031215 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbb0cd-a11f-4298-b4a7-26e449b988bc None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:38.081839 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2a0bc-5bdb-4c97-a414-cdf540920d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:38.082982 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2a0bc-5bdb-4c97-a414-cdf540920d1a None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:38.083382 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2a0bc-5bdb-4c97-a414-cdf540920d1a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:38.083863 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2a0bc-5bdb-4c97-a414-cdf540920d1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:38.093057 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2a0bc-5bdb-4c97-a414-cdf540920d1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:38.095196 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2a0bc-5bdb-4c97-a414-cdf540920d1a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:38.113344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-d8a2a0bc-5bdb-4c97-a414-cdf540920d1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:38.113344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:38.113344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:38.113344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:38.113344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:38.113344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:38.113344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:38.113344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:38.113344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:38.113344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:38.113344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:38.113344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:38.113344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:44:38.113344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:44:38.113344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:44:38.115013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:44:38.115013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:38.115013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:38.115013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:38.115013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:38.115013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:38.115013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:38.115013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:38.115013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:38.115013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:38.115013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:38.115013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:38.115013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:38.115013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:38.115013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:38.115013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:38.115013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:38.116363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:44:38.116363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:44:38.116363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:44:38.116363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:44:38.116363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:44:38.116363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:44:38.116363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:38.116363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:38.116363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 312/635] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:38.120568 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2a0bc-5bdb-4c97-a414-cdf540920d1a None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:38.135666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a2f0a-b577-458b-b9c7-bcd2ef41cac8 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:38.177120 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae48d8-6f31-4a29-81f3-41fdb3c68950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:38.177794 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae48d8-6f31-4a29-81f3-41fdb3c68950 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:38.178351 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae48d8-6f31-4a29-81f3-41fdb3c68950 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:38.178639 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae48d8-6f31-4a29-81f3-41fdb3c68950 None admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:38.179421 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae48d8-6f31-4a29-81f3-41fdb3c68950 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:38.179729 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae48d8-6f31-4a29-81f3-41fdb3c68950 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:38.181631 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae48d8-6f31-4a29-81f3-41fdb3c68950 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:38.196287 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 324/636] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:44:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:38.203412 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae48d8-6f31-4a29-81f3-41fdb3c68950 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:38.243949 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2a0bc-5bdb-4c97-a414-cdf540920d1a None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:38.286852 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89e66a-b361-4e56-88c6-56cd5db722eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:38.287790 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89e66a-b361-4e56-88c6-56cd5db722eb None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:38.288095 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89e66a-b361-4e56-88c6-56cd5db722eb None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:38.288379 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89e66a-b361-4e56-88c6-56cd5db722eb None admin] PATH_INFO: `/v3/projects` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:38.289160 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89e66a-b361-4e56-88c6-56cd5db722eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:38.289468 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89e66a-b361-4e56-88c6-56cd5db722eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:38.291860 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89e66a-b361-4e56-88c6-56cd5db722eb None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:38.308086 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 313/637] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:44:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:38.313477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89e66a-b361-4e56-88c6-56cd5db722eb None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:38.328540 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae48d8-6f31-4a29-81f3-41fdb3c68950 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:38.362950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82661df-35f1-42e0-a30c-047091849f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:38.363559 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82661df-35f1-42e0-a30c-047091849f80 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:38.364190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82661df-35f1-42e0-a30c-047091849f80 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:38.364190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82661df-35f1-42e0-a30c-047091849f80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:38.364954 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82661df-35f1-42e0-a30c-047091849f80 None admin] RBAC: Adding query filter params (role.id=78258bf52d1f4340bb3f7eda6a73f71a, scope.project.id=758931ec3ed54a1eadf1b9a463fbb241, user.id=31e2b07c860d4316b35b1656f2f1c1aa) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:38.365265 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82661df-35f1-42e0-a30c-047091849f80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:38.366695 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82661df-35f1-42e0-a30c-047091849f80 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:38.380390 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 325/638] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:44:38 2022] GET /identity/v3/role_assignments?user.id=31e2b07c860d4316b35b1656f2f1c1aa&scope.project.id=758931ec3ed54a1eadf1b9a463fbb241&role.id=78258bf52d1f4340bb3f7eda6a73f71a => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:38.431731 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89e66a-b361-4e56-88c6-56cd5db722eb None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:38.473041 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56b0a6-72c6-4322-a44b-c36d52938c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:38.474265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56b0a6-72c6-4322-a44b-c36d52938c40 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:38.474757 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56b0a6-72c6-4322-a44b-c36d52938c40 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:38.475299 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56b0a6-72c6-4322-a44b-c36d52938c40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:38.476430 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56b0a6-72c6-4322-a44b-c36d52938c40 None admin] RBAC: Adding query filter params (role.id=78258bf52d1f4340bb3f7eda6a73f71a, scope.project.id=758931ec3ed54a1eadf1b9a463fbb241, user.id=351c1af1091f4f97962da2c5e2d330d5) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:38.476972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56b0a6-72c6-4322-a44b-c36d52938c40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:38.478722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56b0a6-72c6-4322-a44b-c36d52938c40 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:38.487204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 314/639] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:44:38 2022] GET /identity/v3/role_assignments?user.id=351c1af1091f4f97962da2c5e2d330d5&scope.project.id=758931ec3ed54a1eadf1b9a463fbb241&role.id=78258bf52d1f4340bb3f7eda6a73f71a => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:38.674918 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fbd0c-6f7e-414d-a99d-5bbe54f13bfe None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:38.675229 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fbd0c-6f7e-414d-a99d-5bbe54f13bfe None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:38.675491 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fbd0c-6f7e-414d-a99d-5bbe54f13bfe None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:38.676978 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 326/640] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:38.682908 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dd4cb-b791-4a12-bcb5-fea97d0682d3 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:38.683201 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dd4cb-b791-4a12-bcb5-fea97d0682d3 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:38.683470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dd4cb-b791-4a12-bcb5-fea97d0682d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:38.701812 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-de5dd4cb-b791-4a12-bcb5-fea97d0682d3 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:38.703020 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-de5dd4cb-b791-4a12-bcb5-fea97d0682d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:38.772726 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 315/641] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:38.797920 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85fbd0c-6f7e-414d-a99d-5bbe54f13bfe None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:38.907568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85fbd0c-6f7e-414d-a99d-5bbe54f13bfe None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:38.942790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473d519-5fb8-47d1-975b-6e9774103e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:38.943498 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473d519-5fb8-47d1-975b-6e9774103e90 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:38.943778 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473d519-5fb8-47d1-975b-6e9774103e90 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:38.944061 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473d519-5fb8-47d1-975b-6e9774103e90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:38.955069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473d519-5fb8-47d1-975b-6e9774103e90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:38.962564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-5473d519-5fb8-47d1-975b-6e9774103e90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:44:38.962564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:38.962564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:38.962564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:38.962564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:38.962564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:38.962564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:38.962564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:38.962564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:38.962564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:38.962564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:38.962564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:38.962564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:38.962564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:38.962564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:38.962564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:38.963565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:38.963565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:38.963565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:38.963565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:38.963565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:38.963565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:38.963565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:38.963565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:38.963565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:38.963565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:38.963565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:38.963565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:38.963565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:38.963565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:38.963565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:38.963565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:38.964878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:38.964878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:38.964878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:38.964878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:38.964878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:38.964878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:38.964878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:38.964878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:38.964878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:38.964878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:38.964878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:44:38.964878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:38.964878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 327/642] 10.222.0.18 () {56 vars in 1096 bytes} [Mon May 2 08:44:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:38.970578 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dd4cb-b791-4a12-bcb5-fea97d0682d3 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:39.067381 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dd4cb-b791-4a12-bcb5-fea97d0682d3 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:39.099902 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebca7c4-cea3-4305-b5e0-3b32be6718b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:39.100594 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebca7c4-cea3-4305-b5e0-3b32be6718b3 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:39.100878 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebca7c4-cea3-4305-b5e0-3b32be6718b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:39.101148 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebca7c4-cea3-4305-b5e0-3b32be6718b3 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:39.101888 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebca7c4-cea3-4305-b5e0-3b32be6718b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:39.102366 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebca7c4-cea3-4305-b5e0-3b32be6718b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:39.103744 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebca7c4-cea3-4305-b5e0-3b32be6718b3 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:39.112685 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 316/643] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:39.118064 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473d519-5fb8-47d1-975b-6e9774103e90 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:39.219161 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473d519-5fb8-47d1-975b-6e9774103e90 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:39.252545 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a98f8-f565-47db-aa9b-a9d7f9a4b584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:39.253654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a98f8-f565-47db-aa9b-a9d7f9a4b584 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:39.254158 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a98f8-f565-47db-aa9b-a9d7f9a4b584 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:39.254681 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a98f8-f565-47db-aa9b-a9d7f9a4b584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:39.272097 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a98f8-f565-47db-aa9b-a9d7f9a4b584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:39.272097 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a98f8-f565-47db-aa9b-a9d7f9a4b584 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:39.285071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-ec4a98f8-f565-47db-aa9b-a9d7f9a4b584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:39.285071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:39.285071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:39.285071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:39.285071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:39.285071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:39.285071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:39.285071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:39.285071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:39.285071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:39.285071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:39.285071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:39.285071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:39.285071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:39.285071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:39.286000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:39.286000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:39.286000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:39.286000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:39.286000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:39.286000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:39.286000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:39.286000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:39.286000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:39.286000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:39.286000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:39.286000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:39.286000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:39.286000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:39.286000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:39.286000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:39.286000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:39.287391 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:39.287391 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:39.287391 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:39.287391 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:39.287391 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 328/644] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:39.291999 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebca7c4-cea3-4305-b5e0-3b32be6718b3 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:39.393741 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebca7c4-cea3-4305-b5e0-3b32be6718b3 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:39.428063 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba654d-e232-4dd8-be52-066370b949eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:39.428803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba654d-e232-4dd8-be52-066370b949eb None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:39.429084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba654d-e232-4dd8-be52-066370b949eb None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:39.429408 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba654d-e232-4dd8-be52-066370b949eb None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:39.430176 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba654d-e232-4dd8-be52-066370b949eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:39.430482 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba654d-e232-4dd8-be52-066370b949eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:39.431856 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba654d-e232-4dd8-be52-066370b949eb None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:39.446397 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 317/645] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:39.452168 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a98f8-f565-47db-aa9b-a9d7f9a4b584 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:39.553068 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a98f8-f565-47db-aa9b-a9d7f9a4b584 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:39.586732 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a593c1-1f9b-40c4-80b0-bae914e1766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:39.587526 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a593c1-1f9b-40c4-80b0-bae914e1766c None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:39.587810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a593c1-1f9b-40c4-80b0-bae914e1766c None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:39.588102 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a593c1-1f9b-40c4-80b0-bae914e1766c None admin] PATH_INFO: `/v3/users/nova` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:39.596390 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a593c1-1f9b-40c4-80b0-bae914e1766c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:39.597845 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a593c1-1f9b-40c4-80b0-bae914e1766c None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:39.611817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-b3a593c1-1f9b-40c4-80b0-bae914e1766c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 02 08:44:39.611817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:39.611817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:39.611817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:39.611817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:39.611817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:39.611817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:39.611817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:39.611817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:39.611817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:39.611817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:39.611817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:39.611817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:44:39.611817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:44:39.611817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:44:39.611817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:44:39.614058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:39.614058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:39.614058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:44:39.614058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:39.614058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:44:39.614058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:39.614058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:39.614058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:39.614058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:39.614058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:39.614058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:39.614058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:39.614058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:39.614058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:39.614058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:39.614058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:39.614058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:39.614058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:39.616358 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:39.616358 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:39.616358 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:44:39.616358 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:44:39.616358 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:44:39.616358 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:44:39.616358 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:44:39.616358 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:44:39.616358 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 02 08:44:39.616358 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:39.616358 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 329/646] 10.222.0.18 () {56 vars in 1093 bytes} [Mon May 2 08:44:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:39.620473 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba654d-e232-4dd8-be52-066370b949eb None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:39.722065 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba654d-e232-4dd8-be52-066370b949eb None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:39.756478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dab639-878d-43c4-b816-1e9406975864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:39.757154 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dab639-878d-43c4-b816-1e9406975864 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:39.757435 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dab639-878d-43c4-b816-1e9406975864 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:39.757711 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dab639-878d-43c4-b816-1e9406975864 None admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:39.758531 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dab639-878d-43c4-b816-1e9406975864 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:39.758839 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dab639-878d-43c4-b816-1e9406975864 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:39.760290 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dab639-878d-43c4-b816-1e9406975864 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:39.779233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 318/647] 10.222.0.18 () {56 vars in 1133 bytes} [Mon May 2 08:44:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:39.785111 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a593c1-1f9b-40c4-80b0-bae914e1766c None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:39.889691 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a593c1-1f9b-40c4-80b0-bae914e1766c None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:39.925117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00739c1-d8dc-4cca-943c-85bfde745c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:39.925783 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00739c1-d8dc-4cca-943c-85bfde745c4d None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:39.926063 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00739c1-d8dc-4cca-943c-85bfde745c4d None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:39.926334 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00739c1-d8dc-4cca-943c-85bfde745c4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:39.996351 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00739c1-d8dc-4cca-943c-85bfde745c4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:39.998337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00739c1-d8dc-4cca-943c-85bfde745c4d None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:40.097481 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 330/648] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 08:44:40.102857 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dab639-878d-43c4-b816-1e9406975864 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:40.108122 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984aba8d-d82d-4f59-b6bc-ee2c043505c7 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:40.108122 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984aba8d-d82d-4f59-b6bc-ee2c043505c7 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:40.108122 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984aba8d-d82d-4f59-b6bc-ee2c043505c7 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:40.109959 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 331/649] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:44:40.115890 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426bd6c-49b8-47a3-a343-424a2df00bbc None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:40.115890 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426bd6c-49b8-47a3-a343-424a2df00bbc None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:40.115890 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426bd6c-49b8-47a3-a343-424a2df00bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:40.131870 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-2426bd6c-49b8-47a3-a343-424a2df00bbc None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:40.133369 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-2426bd6c-49b8-47a3-a343-424a2df00bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:40.208180 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 332/650] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:44:40.221131 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dab639-878d-43c4-b816-1e9406975864 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:40.227212 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426bd6c-49b8-47a3-a343-424a2df00bbc None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:40.259570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fa24a-b2a9-4775-abb0-2454bcdedadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:40.260779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fa24a-b2a9-4775-abb0-2454bcdedadd None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:40.261267 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fa24a-b2a9-4775-abb0-2454bcdedadd None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:40.261741 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fa24a-b2a9-4775-abb0-2454bcdedadd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:40.272822 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fa24a-b2a9-4775-abb0-2454bcdedadd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:40.274679 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fa24a-b2a9-4775-abb0-2454bcdedadd None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:40.293346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-5e6fa24a-b2a9-4775-abb0-2454bcdedadd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:40.293346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:40.293346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:40.293346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:40.293346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:40.293346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:40.293346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:40.293346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:40.293346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:40.293346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:40.293346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:40.293346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:40.293346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:40.293346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:40.293346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:40.294256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:40.294256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:40.294256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:40.294256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:40.294256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:40.294256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:40.294256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:40.294256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:40.294256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:40.294256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:40.294256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:40.294256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:40.294256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:40.294256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:40.294256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:40.294256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:40.294256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:40.295460 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:40.295460 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:40.295460 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:40.295460 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:40.297776 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 319/651] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:40.303704 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fa24a-b2a9-4775-abb0-2454bcdedadd None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:40.337663 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426bd6c-49b8-47a3-a343-424a2df00bbc None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:40.373332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3895b7-bcc1-4ce1-ad0a-9d76af8f5e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:40.374589 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3895b7-bcc1-4ce1-ad0a-9d76af8f5e4f None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:40.375177 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3895b7-bcc1-4ce1-ad0a-9d76af8f5e4f None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:40.375651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3895b7-bcc1-4ce1-ad0a-9d76af8f5e4f None admin] PATH_INFO: `/v3/services/image` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:40.376563 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3895b7-bcc1-4ce1-ad0a-9d76af8f5e4f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:40.378207 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3895b7-bcc1-4ce1-ad0a-9d76af8f5e4f None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:40.393160 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-ea3895b7-bcc1-4ce1-ad0a-9d76af8f5e4f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 02 08:44:40.393160 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:40.393160 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:44:40.393160 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:44:40.393160 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:44:40.393160 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:44:40.393160 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:44:40.393160 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:40.393160 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 02 08:44:40.393160 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:40.393160 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:44:40.393160 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:40.393160 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:40.393160 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:40.393160 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:40.393160 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:40.393160 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:40.394190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:40.394190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:40.394190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:40.394190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:40.394190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:40.394190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:40.394190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:44:40.394190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:44:40.394190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:44:40.394190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:44:40.394190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:40.394190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:40.394190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:40.394190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:40.394190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:40.394190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:40.395032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:40.395032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:40.395032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:40.395032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:40.395032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:40.395032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:40.395032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:40.395032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:40.395032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:40.395032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:40.395032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:44:40.395032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:40.395032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 02 08:44:40.395032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:40.398744 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 333/652] 10.222.0.18 () {56 vars in 1105 bytes} [Mon May 2 08:44:40 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:40.403889 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3895b7-bcc1-4ce1-ad0a-9d76af8f5e4f None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:40.404645 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fa24a-b2a9-4775-abb0-2454bcdedadd None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:40.439891 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8198313-529d-4752-a14d-149c626fd4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:40.440223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8198313-529d-4752-a14d-149c626fd4f2 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:40.440459 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8198313-529d-4752-a14d-149c626fd4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:40.440738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8198313-529d-4752-a14d-149c626fd4f2 None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:40.441448 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8198313-529d-4752-a14d-149c626fd4f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:40.441754 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8198313-529d-4752-a14d-149c626fd4f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:40.443129 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8198313-529d-4752-a14d-149c626fd4f2 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:40.462770 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 320/653] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:40.463865 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8198313-529d-4752-a14d-149c626fd4f2 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:40.509624 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3895b7-bcc1-4ce1-ad0a-9d76af8f5e4f None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:40.553829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b4d03-9e3b-4d68-8210-a75678164dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:40.554638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b4d03-9e3b-4d68-8210-a75678164dd2 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:40.555015 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b4d03-9e3b-4d68-8210-a75678164dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:40.555387 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b4d03-9e3b-4d68-8210-a75678164dd2 None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:40.556398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b4d03-9e3b-4d68-8210-a75678164dd2 None admin] RBAC: Adding query filter params (name=image) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:40.556808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b4d03-9e3b-4d68-8210-a75678164dd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:40.558715 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b4d03-9e3b-4d68-8210-a75678164dd2 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:40.568131 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 334/654] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:40.571882 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b4d03-9e3b-4d68-8210-a75678164dd2 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:40.577223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8198313-529d-4752-a14d-149c626fd4f2 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:40.620344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7a462-322e-4fb4-a25d-dfd5cd45aee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:40.621608 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7a462-322e-4fb4-a25d-dfd5cd45aee0 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:40.621941 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7a462-322e-4fb4-a25d-dfd5cd45aee0 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:40.622221 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7a462-322e-4fb4-a25d-dfd5cd45aee0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:40.631701 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7a462-322e-4fb4-a25d-dfd5cd45aee0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:40.633742 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7a462-322e-4fb4-a25d-dfd5cd45aee0 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:40.654988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-b9f7a462-322e-4fb4-a25d-dfd5cd45aee0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:40.654988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:40.654988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:40.654988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:40.654988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:40.654988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:40.654988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:40.654988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:40.654988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:40.654988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:40.654988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:40.654988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:40.654988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:44:40.654988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:44:40.654988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:44:40.655967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:44:40.655967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:40.655967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:40.655967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:40.655967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:40.655967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:40.655967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:40.655967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:40.655967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:40.655967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:40.655967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:40.655967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:40.655967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:40.655967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:40.655967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:40.655967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:40.655967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:40.656903 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:44:40.656903 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:44:40.656903 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:44:40.656903 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:44:40.656903 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:44:40.656903 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:44:40.656903 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:40.656903 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:40.661875 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 321/655] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:40.663186 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7a462-322e-4fb4-a25d-dfd5cd45aee0 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:40.697519 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b4d03-9e3b-4d68-8210-a75678164dd2 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:40.733030 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82771513-8b07-477a-8362-decfa8a3dd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:40.734017 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82771513-8b07-477a-8362-decfa8a3dd72 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:40.734522 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82771513-8b07-477a-8362-decfa8a3dd72 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:40.734992 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82771513-8b07-477a-8362-decfa8a3dd72 None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:40.735888 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82771513-8b07-477a-8362-decfa8a3dd72 None admin] RBAC: Adding query filter params (type=image) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:40.736434 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82771513-8b07-477a-8362-decfa8a3dd72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:40.737993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82771513-8b07-477a-8362-decfa8a3dd72 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:40.744447 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 335/656] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:40.793860 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7a462-322e-4fb4-a25d-dfd5cd45aee0 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:40.830287 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673ef8e-c0c9-4456-9fb5-a04b813cecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:40.831354 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673ef8e-c0c9-4456-9fb5-a04b813cecc3 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:40.831887 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673ef8e-c0c9-4456-9fb5-a04b813cecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:40.832477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673ef8e-c0c9-4456-9fb5-a04b813cecc3 None admin] PATH_INFO: `/v3/projects` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:40.833521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673ef8e-c0c9-4456-9fb5-a04b813cecc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:40.834066 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673ef8e-c0c9-4456-9fb5-a04b813cecc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:40.835830 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673ef8e-c0c9-4456-9fb5-a04b813cecc3 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:40.837690 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480926d9-97b5-48a6-9c26-7b93ddfba819 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:40.838086 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480926d9-97b5-48a6-9c26-7b93ddfba819 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:40.838473 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480926d9-97b5-48a6-9c26-7b93ddfba819 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:40.840235 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 336/657] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:44:40.846731 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b85d3-cc58-46cf-904a-2fb9b042fccb None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:40.847139 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b85d3-cc58-46cf-904a-2fb9b042fccb None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:40.847525 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b85d3-cc58-46cf-904a-2fb9b042fccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:40.852084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 322/658] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:44:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:40.861121 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673ef8e-c0c9-4456-9fb5-a04b813cecc3 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:40.869957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-df0b85d3-cc58-46cf-904a-2fb9b042fccb None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:40.871354 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-df0b85d3-cc58-46cf-904a-2fb9b042fccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:40.965850 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 337/659] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:44:40.972917 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8039b-d074-469b-a182-3e781f9273c9 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:40.973215 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8039b-d074-469b-a182-3e781f9273c9 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:40.973499 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8039b-d074-469b-a182-3e781f9273c9 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:40.974968 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 338/660] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:40.975221 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673ef8e-c0c9-4456-9fb5-a04b813cecc3 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:40.980991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe13aa-b911-4248-9741-64194b975b63 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:40.980991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe13aa-b911-4248-9741-64194b975b63 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:40.981229 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe13aa-b911-4248-9741-64194b975b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:40.998997 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-24fe13aa-b911-4248-9741-64194b975b63 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:41.000140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-24fe13aa-b911-4248-9741-64194b975b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:41.011726 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef6f79-fe1d-4eab-9caa-db7c8d8dc707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:41.012418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef6f79-fe1d-4eab-9caa-db7c8d8dc707 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:41.012701 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef6f79-fe1d-4eab-9caa-db7c8d8dc707 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:41.012975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef6f79-fe1d-4eab-9caa-db7c8d8dc707 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:41.014596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef6f79-fe1d-4eab-9caa-db7c8d8dc707 None admin] RBAC: Adding query filter params (role.id=509216a314244b96b05d3fe56b0d9cd1, scope.project.id=758931ec3ed54a1eadf1b9a463fbb241, user.id=97308967556844019594cd0c4abc41fc) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:41.015033 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef6f79-fe1d-4eab-9caa-db7c8d8dc707 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:41.016571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef6f79-fe1d-4eab-9caa-db7c8d8dc707 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:41.022154 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 323/661] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:44:40 2022] GET /identity/v3/role_assignments?user.id=97308967556844019594cd0c4abc41fc&scope.project.id=758931ec3ed54a1eadf1b9a463fbb241&role.id=509216a314244b96b05d3fe56b0d9cd1 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:41.022941 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef6f79-fe1d-4eab-9caa-db7c8d8dc707 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:41.087449 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 339/662] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 08:44:41.111576 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe13aa-b911-4248-9741-64194b975b63 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:41.147545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef6f79-fe1d-4eab-9caa-db7c8d8dc707 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:41.184970 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67d935-3519-41ec-a1dc-14ee46051d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:41.186288 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67d935-3519-41ec-a1dc-14ee46051d7b None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:41.186924 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67d935-3519-41ec-a1dc-14ee46051d7b None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:41.187412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67d935-3519-41ec-a1dc-14ee46051d7b None admin] PATH_INFO: `/v3/services/network` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:41.188362 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67d935-3519-41ec-a1dc-14ee46051d7b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:41.189997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67d935-3519-41ec-a1dc-14ee46051d7b None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:41.206356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-1d67d935-3519-41ec-a1dc-14ee46051d7b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 02 08:44:41.206356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:41.206356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:44:41.206356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:44:41.206356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:44:41.206356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:44:41.206356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:44:41.206356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:41.206356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 02 08:44:41.206356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:41.206356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:44:41.206356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:41.206356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:41.206356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:41.206356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:41.206356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:41.206356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:41.207411 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:41.207411 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:41.207411 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:41.207411 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:41.207411 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:41.207411 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:41.207411 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:44:41.207411 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:44:41.207411 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:44:41.207411 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:44:41.207411 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:41.207411 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:41.207411 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:41.207411 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:41.207411 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:41.207411 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:41.208287 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:41.208287 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:41.208287 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:41.208287 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:41.208287 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:41.208287 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:41.208287 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:41.208287 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:41.208287 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:41.208287 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:41.208287 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:44:41.208287 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:41.208287 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 02 08:44:41.208287 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:41.211098 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 324/663] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:41 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:41.217049 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67d935-3519-41ec-a1dc-14ee46051d7b None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:41.218510 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe13aa-b911-4248-9741-64194b975b63 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:41.259627 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf3542-4d9c-4975-b4bd-e2c942b12ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:41.260386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf3542-4d9c-4975-b4bd-e2c942b12ed3 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:41.260664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf3542-4d9c-4975-b4bd-e2c942b12ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:41.260931 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf3542-4d9c-4975-b4bd-e2c942b12ed3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:41.261580 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf3542-4d9c-4975-b4bd-e2c942b12ed3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:41.263065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf3542-4d9c-4975-b4bd-e2c942b12ed3 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:41.276359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-cecf3542-4d9c-4975-b4bd-e2c942b12ed3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 02 08:44:41.276359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:41.276359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:44:41.276359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:44:41.276359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:44:41.276359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:44:41.276359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:44:41.276359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:41.276359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 02 08:44:41.276359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:41.276359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:44:41.276359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:41.276359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:41.276359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:41.276359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:41.276359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:41.277372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:41.277372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:41.277372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:41.277372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:41.277372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:41.277372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:41.277372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:41.277372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:44:41.277372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:44:41.277372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:44:41.277372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:44:41.277372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:41.277372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:41.277372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:41.277372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:41.277372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:41.278217 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:41.278217 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:41.278217 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:41.278217 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:41.278217 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:41.278217 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:41.278217 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:41.278217 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:41.278217 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:41.278217 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:41.278217 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:41.278217 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:44:41.278217 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:41.278217 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 02 08:44:41.278217 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:41.282793 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 340/664] 10.222.0.18 () {56 vars in 1129 bytes} [Mon May 2 08:44:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:41.284078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf3542-4d9c-4975-b4bd-e2c942b12ed3 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:41.336136 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67d935-3519-41ec-a1dc-14ee46051d7b None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:41.369314 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ea4e0-42c8-4f66-bae2-70996e288803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:41.369990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ea4e0-42c8-4f66-bae2-70996e288803 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:41.370272 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ea4e0-42c8-4f66-bae2-70996e288803 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:41.370543 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ea4e0-42c8-4f66-bae2-70996e288803 None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:41.371320 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ea4e0-42c8-4f66-bae2-70996e288803 None admin] RBAC: Adding query filter params (name=network) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:41.371534 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ea4e0-42c8-4f66-bae2-70996e288803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:41.373154 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ea4e0-42c8-4f66-bae2-70996e288803 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:41.377946 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 325/665] 10.222.0.18 () {56 vars in 1112 bytes} [Mon May 2 08:44:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:41.382892 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ea4e0-42c8-4f66-bae2-70996e288803 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:41.410660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf3542-4d9c-4975-b4bd-e2c942b12ed3 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:41.454868 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8b817-b7f9-4bdc-aab5-6a8ef9d16c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:41.456293 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8b817-b7f9-4bdc-aab5-6a8ef9d16c5b None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:41.456741 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8b817-b7f9-4bdc-aab5-6a8ef9d16c5b None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:41.457171 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8b817-b7f9-4bdc-aab5-6a8ef9d16c5b None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:41.458309 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8b817-b7f9-4bdc-aab5-6a8ef9d16c5b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:41.458798 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8b817-b7f9-4bdc-aab5-6a8ef9d16c5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:41.460514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8b817-b7f9-4bdc-aab5-6a8ef9d16c5b None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:41.465862 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 341/666] 10.222.0.18 () {56 vars in 1124 bytes} [Mon May 2 08:44:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:41.472790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8b817-b7f9-4bdc-aab5-6a8ef9d16c5b None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:41.504038 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ea4e0-42c8-4f66-bae2-70996e288803 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:41.546736 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f61f6-fe10-45b6-8ca6-acf40aefe495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:41.548122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f61f6-fe10-45b6-8ca6-acf40aefe495 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:41.548596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f61f6-fe10-45b6-8ca6-acf40aefe495 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:41.549459 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f61f6-fe10-45b6-8ca6-acf40aefe495 None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:41.550356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f61f6-fe10-45b6-8ca6-acf40aefe495 None admin] RBAC: Adding query filter params (type=network) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:41.550863 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f61f6-fe10-45b6-8ca6-acf40aefe495 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:41.552489 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f61f6-fe10-45b6-8ca6-acf40aefe495 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:41.568749 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 326/667] 10.222.0.18 () {56 vars in 1112 bytes} [Mon May 2 08:44:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:41.585379 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8b817-b7f9-4bdc-aab5-6a8ef9d16c5b None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:41.622200 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ced8ce-90fa-4a39-ad16-a08f694c076b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:41.622901 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ced8ce-90fa-4a39-ad16-a08f694c076b None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:41.623180 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ced8ce-90fa-4a39-ad16-a08f694c076b None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:41.623451 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ced8ce-90fa-4a39-ad16-a08f694c076b None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:41.624185 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ced8ce-90fa-4a39-ad16-a08f694c076b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:41.624488 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ced8ce-90fa-4a39-ad16-a08f694c076b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:41.625895 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ced8ce-90fa-4a39-ad16-a08f694c076b None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:41.636183 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 342/668] 10.222.0.18 () {56 vars in 1124 bytes} [Mon May 2 08:44:41 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:43.196415 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b442a-b3a8-4b87-8c79-cc6eb97030d3 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:43.197194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b442a-b3a8-4b87-8c79-cc6eb97030d3 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:43.197303 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b442a-b3a8-4b87-8c79-cc6eb97030d3 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:43.198964 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 327/669] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:43.205334 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c998f3d-5425-43df-80d3-2db59138ddd6 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:43.205875 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c998f3d-5425-43df-80d3-2db59138ddd6 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:43.205875 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c998f3d-5425-43df-80d3-2db59138ddd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:43.225753 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-3c998f3d-5425-43df-80d3-2db59138ddd6 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:43.226970 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-3c998f3d-5425-43df-80d3-2db59138ddd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:43.295589 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 343/670] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:43.319808 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b442a-b3a8-4b87-8c79-cc6eb97030d3 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:43.386755 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162992-959a-4f97-af1a-0b03c838fb8e None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:43.387080 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162992-959a-4f97-af1a-0b03c838fb8e None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:43.387324 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162992-959a-4f97-af1a-0b03c838fb8e None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:43.389771 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 344/671] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:44:43.394775 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b4c89-b453-4aa2-9bcb-74a48e7f144f None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:43.395059 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b4c89-b453-4aa2-9bcb-74a48e7f144f None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:43.407308 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b4c89-b453-4aa2-9bcb-74a48e7f144f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:43.414966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-9a5b4c89-b453-4aa2-9bcb-74a48e7f144f None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:43.416984 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-9a5b4c89-b453-4aa2-9bcb-74a48e7f144f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:43.429137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b442a-b3a8-4b87-8c79-cc6eb97030d3 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:43.464761 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d5fd5-051c-48d4-8dca-cd9f989a68e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:43.465354 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d5fd5-051c-48d4-8dca-cd9f989a68e2 None admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:43.465638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d5fd5-051c-48d4-8dca-cd9f989a68e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:43.465917 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d5fd5-051c-48d4-8dca-cd9f989a68e2 None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:43.466765 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d5fd5-051c-48d4-8dca-cd9f989a68e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:43.468708 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d5fd5-051c-48d4-8dca-cd9f989a68e2 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:43.500140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 345/672] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:43.520980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b4c89-b453-4aa2-9bcb-74a48e7f144f None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:43.556080 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 328/673] 10.222.0.18 () {60 vars in 1141 bytes} [Mon May 2 08:44:43 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:44:43.639804 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b4c89-b453-4aa2-9bcb-74a48e7f144f None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:43.690539 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd20150-159a-4627-99cf-44c22048a0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:43.691348 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd20150-159a-4627-99cf-44c22048a0ef None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:43.691630 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd20150-159a-4627-99cf-44c22048a0ef None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:43.691906 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd20150-159a-4627-99cf-44c22048a0ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:43.705304 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd20150-159a-4627-99cf-44c22048a0ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:43.713093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-fdd20150-159a-4627-99cf-44c22048a0ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:44:43.713093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:43.713093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:43.713093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:43.713093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:43.713093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:43.713093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:43.713093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:43.713093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:43.713093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:43.713093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:43.713093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:43.713093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:43.713093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:43.713093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:43.713093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:43.714073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:43.714073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:43.714073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:43.714073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:43.714073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:43.714073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:43.714073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:43.714073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:43.714073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:43.714073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:43.714073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:43.714073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:43.714073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:43.714073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:43.714073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:43.714073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:43.714991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:43.714991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:43.714991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:43.714991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:43.714991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:43.714991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:43.714991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:43.714991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:43.714991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:43.714991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:43.714991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:44:43.714991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:43.714991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 346/674] 10.222.0.18 () {56 vars in 1096 bytes} [Mon May 2 08:44:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:43.721252 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d5fd5-051c-48d4-8dca-cd9f989a68e2 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:43.832740 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d5fd5-051c-48d4-8dca-cd9f989a68e2 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:43.871036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08a26f-c869-4ac9-900a-b04573388630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:43.872091 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08a26f-c869-4ac9-900a-b04573388630 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:43.872609 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08a26f-c869-4ac9-900a-b04573388630 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:43.873578 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08a26f-c869-4ac9-900a-b04573388630 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:43.874732 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08a26f-c869-4ac9-900a-b04573388630 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:43.875264 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08a26f-c869-4ac9-900a-b04573388630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:43.876881 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08a26f-c869-4ac9-900a-b04573388630 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:43.891217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 329/675] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:43.896661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd20150-159a-4627-99cf-44c22048a0ef None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:43.995946 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01910c4e-ea29-418d-8bab-200d88168c6e None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:43.996292 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01910c4e-ea29-418d-8bab-200d88168c6e None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:43.996459 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01910c4e-ea29-418d-8bab-200d88168c6e None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:43.999162 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 330/676] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:44:43.999577 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd20150-159a-4627-99cf-44c22048a0ef None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:44.004015 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ede9b-b37b-4b89-b7a5-d2a791f3f065 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:44.004332 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ede9b-b37b-4b89-b7a5-d2a791f3f065 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:44.004609 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ede9b-b37b-4b89-b7a5-d2a791f3f065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:44.024294 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-1e5ede9b-b37b-4b89-b7a5-d2a791f3f065 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:44.025678 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-1e5ede9b-b37b-4b89-b7a5-d2a791f3f065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:44.037427 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc508b-639f-4cae-b5fb-8f70e0526d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:44.038218 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc508b-639f-4cae-b5fb-8f70e0526d1e None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:44.038502 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc508b-639f-4cae-b5fb-8f70e0526d1e None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:44.038777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc508b-639f-4cae-b5fb-8f70e0526d1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:44.049374 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc508b-639f-4cae-b5fb-8f70e0526d1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:44.050837 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc508b-639f-4cae-b5fb-8f70e0526d1e None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:44.068846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-43bc508b-639f-4cae-b5fb-8f70e0526d1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:44.068846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:44.068846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:44.068846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:44.068846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:44.068846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:44.068846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:44.068846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:44.068846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:44.068846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:44.068846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:44.068846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:44.068846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:44.068846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:44.068846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:44.069877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:44.069877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:44.069877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:44.069877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:44.069877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:44.069877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:44.069877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:44.069877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:44.069877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:44.069877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:44.069877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:44.069877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:44.069877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:44.069877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:44.069877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:44.069877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:44.069877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:44.070817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:44.070817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:44.070817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:44.070817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:44.070817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 347/677] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:44.071954 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cb1a4-34e9-4330-a574-f238ad08454f None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:44.072259 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cb1a4-34e9-4330-a574-f238ad08454f None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:44.072535 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cb1a4-34e9-4330-a574-f238ad08454f None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:44.076097 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 348/678] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:44.076097 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cb1a4-34e9-4330-a574-f238ad08454f None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:44.101250 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 331/679] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:44 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:44.102355 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48016553-4064-4c8c-95b2-16936354c92b None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:44.102645 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48016553-4064-4c8c-95b2-16936354c92b None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:44.102920 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48016553-4064-4c8c-95b2-16936354c92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:44.118804 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-48016553-4064-4c8c-95b2-16936354c92b None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:44.119984 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-48016553-4064-4c8c-95b2-16936354c92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:44.182334 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cb1a4-34e9-4330-a574-f238ad08454f None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:44.192505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 332/680] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:44 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 08:44:44.192505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48016553-4064-4c8c-95b2-16936354c92b None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:44.219896 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facbbc4-6dac-402a-8fe9-13a6554339e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:44.220599 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facbbc4-6dac-402a-8fe9-13a6554339e1 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:44.220882 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facbbc4-6dac-402a-8fe9-13a6554339e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:44.221156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facbbc4-6dac-402a-8fe9-13a6554339e1 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:44.221870 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facbbc4-6dac-402a-8fe9-13a6554339e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:44.222177 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facbbc4-6dac-402a-8fe9-13a6554339e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:44.223587 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facbbc4-6dac-402a-8fe9-13a6554339e1 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:44.239415 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 349/681] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:44.239415 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facbbc4-6dac-402a-8fe9-13a6554339e1 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:44.292394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48016553-4064-4c8c-95b2-16936354c92b None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:44.325294 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d365af-9c1e-45fb-866b-dcc6b8d0626d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:44.325985 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d365af-9c1e-45fb-866b-dcc6b8d0626d None admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:44.326280 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d365af-9c1e-45fb-866b-dcc6b8d0626d None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:44.326546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d365af-9c1e-45fb-866b-dcc6b8d0626d None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:44.327379 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d365af-9c1e-45fb-866b-dcc6b8d0626d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:44.328786 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d365af-9c1e-45fb-866b-dcc6b8d0626d None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:44.335380 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facbbc4-6dac-402a-8fe9-13a6554339e1 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:44.367667 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd171885-202c-4a0c-9683-0a2e00073e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:44.368357 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd171885-202c-4a0c-9683-0a2e00073e49 None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:44.368640 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd171885-202c-4a0c-9683-0a2e00073e49 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:44.368915 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd171885-202c-4a0c-9683-0a2e00073e49 None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:44.369629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd171885-202c-4a0c-9683-0a2e00073e49 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:44.370990 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd171885-202c-4a0c-9683-0a2e00073e49 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:44.402303 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 333/682] 10.222.0.18 () {60 vars in 1141 bytes} [Mon May 2 08:44:44 2022] POST /identity/v3/services => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:44:44.403128 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d365af-9c1e-45fb-866b-dcc6b8d0626d None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:44.488284 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 350/683] 10.222.0.18 () {60 vars in 1141 bytes} [Mon May 2 08:44:44 2022] POST /identity/v3/services => generated 240 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:44:44.528034 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d365af-9c1e-45fb-866b-dcc6b8d0626d None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:44.578407 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d01abd-a929-4731-b4a9-8a5d3664fd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:44.579584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d01abd-a929-4731-b4a9-8a5d3664fd98 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:44.580150 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d01abd-a929-4731-b4a9-8a5d3664fd98 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:44.580694 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d01abd-a929-4731-b4a9-8a5d3664fd98 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:44.589728 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d01abd-a929-4731-b4a9-8a5d3664fd98 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:44.591712 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d01abd-a929-4731-b4a9-8a5d3664fd98 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:44.608974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-60d01abd-a929-4731-b4a9-8a5d3664fd98 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 02 08:44:44.608974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:44.608974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:44.608974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:44.608974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:44.608974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:44.608974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:44.608974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:44.608974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:44.608974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:44.608974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:44.608974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:44.608974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:44:44.608974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:44:44.608974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:44:44.608974 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:44:44.610024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:44.610024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:44.610024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:44:44.610024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:44.610024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:44:44.610024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:44.610024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:44.610024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:44.610024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:44.610024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:44.610024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:44.610024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:44.610024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:44.610024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:44.610024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:44.610024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:44.610024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:44.610024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:44.610989 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:44.610989 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:44.610989 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:44:44.610989 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:44:44.610989 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:44:44.610989 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:44:44.610989 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:44:44.610989 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:44:44.610989 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 02 08:44:44.610989 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:44.613882 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 334/684] 10.222.0.18 () {56 vars in 1093 bytes} [Mon May 2 08:44:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:44.619562 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd171885-202c-4a0c-9683-0a2e00073e49 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:44.742067 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd171885-202c-4a0c-9683-0a2e00073e49 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:44.776966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c403b-fb26-4720-bd3e-2eb5d3170e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:44.777638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c403b-fb26-4720-bd3e-2eb5d3170e86 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:44.777920 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c403b-fb26-4720-bd3e-2eb5d3170e86 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:44.778194 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c403b-fb26-4720-bd3e-2eb5d3170e86 None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:44.779738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c403b-fb26-4720-bd3e-2eb5d3170e86 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:44.780182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c403b-fb26-4720-bd3e-2eb5d3170e86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:44.781616 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c403b-fb26-4720-bd3e-2eb5d3170e86 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:44.803615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 351/685] 10.222.0.18 () {56 vars in 1133 bytes} [Mon May 2 08:44:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:44.805029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d01abd-a929-4731-b4a9-8a5d3664fd98 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:44.910315 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d01abd-a929-4731-b4a9-8a5d3664fd98 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:44.947805 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71fff7-0df8-4198-9bf1-865f3c0bdbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:44.948636 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71fff7-0df8-4198-9bf1-865f3c0bdbab None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:44.948979 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71fff7-0df8-4198-9bf1-865f3c0bdbab None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:44.949263 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71fff7-0df8-4198-9bf1-865f3c0bdbab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:44.959606 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71fff7-0df8-4198-9bf1-865f3c0bdbab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:44.961093 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71fff7-0df8-4198-9bf1-865f3c0bdbab None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:44.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-0e71fff7-0df8-4198-9bf1-865f3c0bdbab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:44.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:44.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:44.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:44.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:44.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:44.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:44.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:44.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:44.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:44.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:44.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:44.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:44.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:44.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:44.979094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:44.979094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:44.979094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:44.979094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:44.979094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:44.979094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:44.979094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:44.979094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:44.979094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:44.979094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:44.979094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:44.979094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:44.979094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:44.979094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:44.979094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:44.979094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:44.979094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:44.980193 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:44.980193 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:44.980193 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:44.980193 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:44.980193 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 335/686] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:44.986384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c403b-fb26-4720-bd3e-2eb5d3170e86 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:45.088752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c403b-fb26-4720-bd3e-2eb5d3170e86 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:45.122741 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd24ed-cae0-456e-a3a5-03825e3fdb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:45.123761 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd24ed-cae0-456e-a3a5-03825e3fdb46 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:45.124281 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd24ed-cae0-456e-a3a5-03825e3fdb46 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:45.124812 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd24ed-cae0-456e-a3a5-03825e3fdb46 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:45.125727 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd24ed-cae0-456e-a3a5-03825e3fdb46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:45.126238 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd24ed-cae0-456e-a3a5-03825e3fdb46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:45.127820 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd24ed-cae0-456e-a3a5-03825e3fdb46 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:45.139505 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 352/687] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:45.144497 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71fff7-0df8-4198-9bf1-865f3c0bdbab None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:45.244533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71fff7-0df8-4198-9bf1-865f3c0bdbab None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:45.279514 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59970713-9a05-47fb-9833-1e0ea8da6514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:45.280349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59970713-9a05-47fb-9833-1e0ea8da6514 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:45.280640 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59970713-9a05-47fb-9833-1e0ea8da6514 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:45.280920 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59970713-9a05-47fb-9833-1e0ea8da6514 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:45.287978 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59970713-9a05-47fb-9833-1e0ea8da6514 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:45.289481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59970713-9a05-47fb-9833-1e0ea8da6514 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:45.304328 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-59970713-9a05-47fb-9833-1e0ea8da6514 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:45.304328 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:45.304328 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:45.304328 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:45.304328 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:45.304328 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:45.304328 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:45.304328 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:45.304328 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:45.304328 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:45.304328 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:45.304328 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:45.304328 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:44:45.304328 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:44:45.304328 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:44:45.306084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:44:45.306084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:45.306084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:45.306084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:45.306084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:45.306084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:45.306084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:45.306084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:45.306084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:45.306084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:45.306084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:45.306084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:45.306084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:45.306084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:45.306084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:45.306084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:45.306084 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:45.307269 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:44:45.307269 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:44:45.307269 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:44:45.307269 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:44:45.307269 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:44:45.307269 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:44:45.307269 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:45.307269 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:45.307269 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 336/688] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:45.312073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd24ed-cae0-456e-a3a5-03825e3fdb46 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:45.415272 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd24ed-cae0-456e-a3a5-03825e3fdb46 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:45.450028 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af50e1-8a0f-4e42-a305-397e4ca92273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:45.450715 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af50e1-8a0f-4e42-a305-397e4ca92273 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:45.451037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af50e1-8a0f-4e42-a305-397e4ca92273 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:45.451319 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af50e1-8a0f-4e42-a305-397e4ca92273 None admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:45.452137 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af50e1-8a0f-4e42-a305-397e4ca92273 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:45.452457 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af50e1-8a0f-4e42-a305-397e4ca92273 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:45.453906 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af50e1-8a0f-4e42-a305-397e4ca92273 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:45.467694 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 353/689] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:44:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:45.473480 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59970713-9a05-47fb-9833-1e0ea8da6514 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:45.574832 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59970713-9a05-47fb-9833-1e0ea8da6514 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:45.610828 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96383f89-c506-4418-a52f-14a82e594c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:45.611726 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96383f89-c506-4418-a52f-14a82e594c07 None admin] REQUEST_METHOD: `PUT` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:45.612008 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96383f89-c506-4418-a52f-14a82e594c07 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:45.612317 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96383f89-c506-4418-a52f-14a82e594c07 None admin] PATH_INFO: `/v3/projects/758931ec3ed54a1eadf1b9a463fbb241/users/97308967556844019594cd0c4abc41fc/roles/509216a314244b96b05d3fe56b0d9cd1` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:45.614439 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96383f89-c506-4418-a52f-14a82e594c07 None admin] RBAC: Authorizing `identity:create_grant(project_id=758931ec3ed54a1eadf1b9a463fbb241, user_id=97308967556844019594cd0c4abc41fc, role_id=509216a314244b96b05d3fe56b0d9cd1)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:45.615906 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96383f89-c506-4418-a52f-14a82e594c07 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:45.677407 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 337/690] 10.222.0.18 () {58 vars in 1439 bytes} [Mon May 2 08:44:45 2022] PUT /identity/v3/projects/758931ec3ed54a1eadf1b9a463fbb241/users/97308967556844019594cd0c4abc41fc/roles/509216a314244b96b05d3fe56b0d9cd1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:44:45.966228 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930c804-6ef7-404b-a8ae-07616a71849b None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:45.967159 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930c804-6ef7-404b-a8ae-07616a71849b None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:45.967329 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930c804-6ef7-404b-a8ae-07616a71849b None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:45.968928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 354/691] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:45.974463 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b062309-a7fc-4019-acb8-c5e5b965f904 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:45.974755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b062309-a7fc-4019-acb8-c5e5b965f904 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:45.975035 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b062309-a7fc-4019-acb8-c5e5b965f904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:45.991795 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-1b062309-a7fc-4019-acb8-c5e5b965f904 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:45.992996 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-1b062309-a7fc-4019-acb8-c5e5b965f904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:46.062074 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 338/692] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:45 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:44:46.084951 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930c804-6ef7-404b-a8ae-07616a71849b None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:46.191993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930c804-6ef7-404b-a8ae-07616a71849b None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:46.229319 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfc234-f70c-4dba-9d8e-f653962769a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:46.230470 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfc234-f70c-4dba-9d8e-f653962769a1 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:46.230963 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfc234-f70c-4dba-9d8e-f653962769a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:46.231442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfc234-f70c-4dba-9d8e-f653962769a1 None admin] PATH_INFO: `/v3/services/image` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:46.232683 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfc234-f70c-4dba-9d8e-f653962769a1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:46.234456 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfc234-f70c-4dba-9d8e-f653962769a1 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:46.246685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-89dfc234-f70c-4dba-9d8e-f653962769a1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 02 08:44:46.246685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:46.246685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:44:46.246685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:44:46.246685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:44:46.246685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:44:46.246685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:44:46.246685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:46.246685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 02 08:44:46.246685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:46.246685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:44:46.246685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:46.246685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:46.246685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:46.246685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:46.246685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:46.246685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:46.247816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:46.247816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:46.247816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:46.247816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:46.247816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:46.247816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:46.247816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:44:46.247816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:44:46.247816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:44:46.247816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:44:46.247816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:46.247816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:46.247816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:46.247816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:46.247816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:46.247816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:46.249041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:46.249041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:46.249041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:46.249041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:46.249041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:46.249041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:46.249041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:46.249041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:46.249041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:46.249041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:46.249041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:44:46.249041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:46.249041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 02 08:44:46.249041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:46.251861 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 355/693] 10.222.0.18 () {56 vars in 1105 bytes} [Mon May 2 08:44:46 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:46.264092 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b062309-a7fc-4019-acb8-c5e5b965f904 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:46.356241 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b062309-a7fc-4019-acb8-c5e5b965f904 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:46.512125 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65137462-3b4f-4752-81bd-eae33d926e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:46.512698 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65137462-3b4f-4752-81bd-eae33d926e24 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:46.512981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65137462-3b4f-4752-81bd-eae33d926e24 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:46.513769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65137462-3b4f-4752-81bd-eae33d926e24 None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:46.514488 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65137462-3b4f-4752-81bd-eae33d926e24 None admin] RBAC: Adding query filter params (name=image) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:46.514789 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65137462-3b4f-4752-81bd-eae33d926e24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:46.516186 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65137462-3b4f-4752-81bd-eae33d926e24 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:46.521244 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 339/694] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:46.526723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfc234-f70c-4dba-9d8e-f653962769a1 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:46.627387 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfc234-f70c-4dba-9d8e-f653962769a1 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:46.669604 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae622e21-10bf-44b6-8dd3-71799c73adea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:46.670642 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae622e21-10bf-44b6-8dd3-71799c73adea None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:46.670931 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae622e21-10bf-44b6-8dd3-71799c73adea None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:46.671209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae622e21-10bf-44b6-8dd3-71799c73adea None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:46.671920 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae622e21-10bf-44b6-8dd3-71799c73adea None admin] RBAC: Adding query filter params (type=image) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:46.672266 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae622e21-10bf-44b6-8dd3-71799c73adea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:46.673661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae622e21-10bf-44b6-8dd3-71799c73adea None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:46.679197 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 356/695] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:46.684602 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65137462-3b4f-4752-81bd-eae33d926e24 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:46.796409 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65137462-3b4f-4752-81bd-eae33d926e24 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:46.830639 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738ed47-bdaf-4874-aad4-1836d50904a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:46.831300 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738ed47-bdaf-4874-aad4-1836d50904a3 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:46.831579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738ed47-bdaf-4874-aad4-1836d50904a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:46.831850 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738ed47-bdaf-4874-aad4-1836d50904a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:46.832660 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738ed47-bdaf-4874-aad4-1836d50904a3 None admin] RBAC: Adding query filter params (interface=public, service_id=480575f6b3a64316b5f23a9428ae84ea, region_id=RegionOne) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:46.832968 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738ed47-bdaf-4874-aad4-1836d50904a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:46.834330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738ed47-bdaf-4874-aad4-1836d50904a3 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:46.842838 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 340/696] 10.222.0.18 () {56 vars in 1251 bytes} [Mon May 2 08:44:46 2022] GET /identity/v3/endpoints?service_id=480575f6b3a64316b5f23a9428ae84ea&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:46.848389 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae622e21-10bf-44b6-8dd3-71799c73adea None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:46.919310 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64db882-ee60-441e-99aa-10003b783e76 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:46.920238 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64db882-ee60-441e-99aa-10003b783e76 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:46.920541 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64db882-ee60-441e-99aa-10003b783e76 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:46.926525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 341/697] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:44:46.928367 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a611a-22ff-4a29-b5d6-c766a1555d34 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:46.928658 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a611a-22ff-4a29-b5d6-c766a1555d34 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:46.928936 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a611a-22ff-4a29-b5d6-c766a1555d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:46.949060 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-236a611a-22ff-4a29-b5d6-c766a1555d34 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:46.951439 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-236a611a-22ff-4a29-b5d6-c766a1555d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:46.963619 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae622e21-10bf-44b6-8dd3-71799c73adea None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:47.004697 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef58d2-ba37-4e14-b8a1-a9acc4046702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:47.005514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef58d2-ba37-4e14-b8a1-a9acc4046702 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:47.006076 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef58d2-ba37-4e14-b8a1-a9acc4046702 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:47.006353 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef58d2-ba37-4e14-b8a1-a9acc4046702 None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:47.007034 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef58d2-ba37-4e14-b8a1-a9acc4046702 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:47.008830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef58d2-ba37-4e14-b8a1-a9acc4046702 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:47.020227 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 357/698] 10.222.0.18 () {56 vars in 1087 bytes} [Mon May 2 08:44:46 2022] GET /identity/v3/services => generated 1002 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 08:44:47.022007 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50acf47-1f07-4125-a5bc-7b9759346087 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:47.022307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50acf47-1f07-4125-a5bc-7b9759346087 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:47.022593 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50acf47-1f07-4125-a5bc-7b9759346087 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:47.023985 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 358/699] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:47.026086 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 342/700] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:46 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 08:44:47.032187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2043aa-66b0-4684-b5eb-6ff9cf2cc277 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:47.032872 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2043aa-66b0-4684-b5eb-6ff9cf2cc277 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:47.033392 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2043aa-66b0-4684-b5eb-6ff9cf2cc277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:47.050903 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a611a-22ff-4a29-b5d6-c766a1555d34 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:47.055705 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-ac2043aa-66b0-4684-b5eb-6ff9cf2cc277 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:47.057426 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-ac2043aa-66b0-4684-b5eb-6ff9cf2cc277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:47.148213 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 359/701] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:47 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:44:47.174869 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2043aa-66b0-4684-b5eb-6ff9cf2cc277 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:47.178800 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a611a-22ff-4a29-b5d6-c766a1555d34 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:47.230031 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58cb9a-53be-4242-bb14-c3a88a34187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:47.231219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58cb9a-53be-4242-bb14-c3a88a34187d None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:47.231737 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58cb9a-53be-4242-bb14-c3a88a34187d None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:47.232748 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58cb9a-53be-4242-bb14-c3a88a34187d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:47.233562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58cb9a-53be-4242-bb14-c3a88a34187d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:47.235573 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58cb9a-53be-4242-bb14-c3a88a34187d None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:47.249291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-7f58cb9a-53be-4242-bb14-c3a88a34187d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 02 08:44:47.249291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:47.249291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:44:47.249291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:44:47.249291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:44:47.249291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:44:47.249291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:44:47.249291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:47.249291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 02 08:44:47.249291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:47.249291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:44:47.249291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:47.249291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:47.249291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:47.249291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:47.249291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:47.250505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:47.250505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:47.250505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:47.250505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:47.250505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:47.250505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:47.250505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:47.250505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:44:47.250505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:44:47.250505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:44:47.250505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:44:47.250505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:47.250505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:47.250505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:47.250505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:47.250505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:47.251649 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:47.251649 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:47.251649 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:47.251649 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:47.251649 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:47.251649 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:47.251649 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:47.251649 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:47.251649 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:47.251649 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:47.251649 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:47.251649 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:44:47.251649 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:47.251649 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 02 08:44:47.251649 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:47.254664 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 343/702] 10.222.0.18 () {56 vars in 1129 bytes} [Mon May 2 08:44:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:47.261419 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58cb9a-53be-4242-bb14-c3a88a34187d None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:47.289328 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2043aa-66b0-4684-b5eb-6ff9cf2cc277 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:47.326230 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1a710-b02e-4b58-8c15-502c7807c7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:47.326985 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1a710-b02e-4b58-8c15-502c7807c7be None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:47.327269 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1a710-b02e-4b58-8c15-502c7807c7be None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:47.327550 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1a710-b02e-4b58-8c15-502c7807c7be None admin] PATH_INFO: `/v3/services/network` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:47.328253 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1a710-b02e-4b58-8c15-502c7807c7be None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:47.329650 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1a710-b02e-4b58-8c15-502c7807c7be None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:47.341730 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-3ad1a710-b02e-4b58-8c15-502c7807c7be None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 02 08:44:47.341730 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:47.341730 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:44:47.341730 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:44:47.341730 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:44:47.341730 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:44:47.341730 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:44:47.341730 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:47.341730 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 02 08:44:47.341730 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:47.341730 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:44:47.341730 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:47.341730 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:47.341730 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:47.341730 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:47.341730 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:47.341730 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:47.343071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:47.343071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:47.343071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:47.343071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:47.343071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:47.343071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:47.343071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:44:47.343071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:44:47.343071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:44:47.343071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:44:47.343071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:47.343071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:47.343071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:47.343071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:47.343071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:47.343071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:47.343902 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:47.343902 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:47.343902 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:47.343902 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:47.343902 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:47.343902 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:47.343902 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:47.343902 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:47.343902 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:47.343902 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:47.343902 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:44:47.343902 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:47.343902 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 02 08:44:47.343902 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:47.343902 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 360/703] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:47 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:47.349892 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1a710-b02e-4b58-8c15-502c7807c7be None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:47.381791 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58cb9a-53be-4242-bb14-c3a88a34187d None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:47.430818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baaa77-81ba-4e56-a4fb-3b9166f5c07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:47.431549 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baaa77-81ba-4e56-a4fb-3b9166f5c07f None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:47.431841 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baaa77-81ba-4e56-a4fb-3b9166f5c07f None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:47.432161 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baaa77-81ba-4e56-a4fb-3b9166f5c07f None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:47.432883 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35baaa77-81ba-4e56-a4fb-3b9166f5c07f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:47.433189 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35baaa77-81ba-4e56-a4fb-3b9166f5c07f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:47.435875 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35baaa77-81ba-4e56-a4fb-3b9166f5c07f None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:47.444215 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 344/704] 10.222.0.18 () {56 vars in 1124 bytes} [Mon May 2 08:44:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:47.449497 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baaa77-81ba-4e56-a4fb-3b9166f5c07f None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:47.464943 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1a710-b02e-4b58-8c15-502c7807c7be None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:47.565203 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baaa77-81ba-4e56-a4fb-3b9166f5c07f None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:47.603473 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2558d02-d69e-4b33-ba40-ef49b3fb4267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:47.604078 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2558d02-d69e-4b33-ba40-ef49b3fb4267 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:47.604374 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2558d02-d69e-4b33-ba40-ef49b3fb4267 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:47.604661 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2558d02-d69e-4b33-ba40-ef49b3fb4267 None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:47.605375 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2558d02-d69e-4b33-ba40-ef49b3fb4267 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:47.605681 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2558d02-d69e-4b33-ba40-ef49b3fb4267 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:47.607117 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2558d02-d69e-4b33-ba40-ef49b3fb4267 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:47.617322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 345/705] 10.222.0.18 () {56 vars in 1124 bytes} [Mon May 2 08:44:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:47.618186 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2558d02-d69e-4b33-ba40-ef49b3fb4267 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:47.626078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46cd56-248a-4aa7-ada7-2919f0218cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:47.626741 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46cd56-248a-4aa7-ada7-2919f0218cbf None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:47.627024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46cd56-248a-4aa7-ada7-2919f0218cbf None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:47.627297 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46cd56-248a-4aa7-ada7-2919f0218cbf None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:47.628003 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46cd56-248a-4aa7-ada7-2919f0218cbf None admin] RBAC: Adding query filter params (name=network) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:47.628338 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46cd56-248a-4aa7-ada7-2919f0218cbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:47.629729 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46cd56-248a-4aa7-ada7-2919f0218cbf None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:47.635166 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 361/706] 10.222.0.18 () {56 vars in 1112 bytes} [Mon May 2 08:44:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:47.641162 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46cd56-248a-4aa7-ada7-2919f0218cbf None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:47.747769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2558d02-d69e-4b33-ba40-ef49b3fb4267 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:47.754226 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46cd56-248a-4aa7-ada7-2919f0218cbf None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:47.783686 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706ccca-6edd-40ad-9922-38117a0ee262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:47.784800 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706ccca-6edd-40ad-9922-38117a0ee262 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:47.785352 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706ccca-6edd-40ad-9922-38117a0ee262 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:47.785857 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706ccca-6edd-40ad-9922-38117a0ee262 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:47.786885 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706ccca-6edd-40ad-9922-38117a0ee262 None admin] RBAC: Adding query filter params (interface=public, service_id=d19bbcd87271440fa6819627f3f7f458, region_id=RegionOne) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:47.787420 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706ccca-6edd-40ad-9922-38117a0ee262 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:47.789035 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706ccca-6edd-40ad-9922-38117a0ee262 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:47.789212 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0795d-f6c7-4c4c-b547-fe003778a53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:47.801963 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0795d-f6c7-4c4c-b547-fe003778a53e None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:47.801963 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0795d-f6c7-4c4c-b547-fe003778a53e None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:47.801963 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0795d-f6c7-4c4c-b547-fe003778a53e None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:47.801963 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0795d-f6c7-4c4c-b547-fe003778a53e None admin] RBAC: Adding query filter params (type=network) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:47.801963 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0795d-f6c7-4c4c-b547-fe003778a53e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:47.801963 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0795d-f6c7-4c4c-b547-fe003778a53e None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:47.802478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 346/707] 10.222.0.18 () {56 vars in 1251 bytes} [Mon May 2 08:44:47 2022] GET /identity/v3/endpoints?service_id=d19bbcd87271440fa6819627f3f7f458&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:47.802572 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 362/708] 10.222.0.18 () {56 vars in 1112 bytes} [Mon May 2 08:44:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:47.803364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706ccca-6edd-40ad-9922-38117a0ee262 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:47.812595 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0795d-f6c7-4c4c-b547-fe003778a53e None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:47.905802 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706ccca-6edd-40ad-9922-38117a0ee262 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:47.920478 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0795d-f6c7-4c4c-b547-fe003778a53e None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:47.941453 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f741a28-28ad-49be-a7ca-6a7e0da0bfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:47.942146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f741a28-28ad-49be-a7ca-6a7e0da0bfcb None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:47.942432 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f741a28-28ad-49be-a7ca-6a7e0da0bfcb None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:47.942711 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f741a28-28ad-49be-a7ca-6a7e0da0bfcb None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:47.943415 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f741a28-28ad-49be-a7ca-6a7e0da0bfcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:47.944911 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f741a28-28ad-49be-a7ca-6a7e0da0bfcb None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:47.960078 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 347/709] 10.222.0.18 () {56 vars in 1087 bytes} [Mon May 2 08:44:47 2022] GET /identity/v3/services => generated 1002 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 08:44:47.970674 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbc8d7-3d3c-4509-a4c3-8cc1f6adaf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:47.971342 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbc8d7-3d3c-4509-a4c3-8cc1f6adaf4a None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:47.971628 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbc8d7-3d3c-4509-a4c3-8cc1f6adaf4a None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:47.971965 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbc8d7-3d3c-4509-a4c3-8cc1f6adaf4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:47.972884 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbc8d7-3d3c-4509-a4c3-8cc1f6adaf4a None admin] RBAC: Adding query filter params (interface=public, service_id=34eaa84b4af546eab7a97c6a1324aa7e, region_id=RegionOne) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:47.973205 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbc8d7-3d3c-4509-a4c3-8cc1f6adaf4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:47.974716 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbc8d7-3d3c-4509-a4c3-8cc1f6adaf4a None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:47.984498 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 363/710] 10.222.0.18 () {56 vars in 1251 bytes} [Mon May 2 08:44:47 2022] GET /identity/v3/endpoints?service_id=34eaa84b4af546eab7a97c6a1324aa7e&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:47.990075 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f741a28-28ad-49be-a7ca-6a7e0da0bfcb None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:48.102153 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f741a28-28ad-49be-a7ca-6a7e0da0bfcb None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:48.141663 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad3a72-abd2-4cea-b576-c038235b9101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:48.141663 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad3a72-abd2-4cea-b576-c038235b9101 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:48.141663 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad3a72-abd2-4cea-b576-c038235b9101 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:48.142024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad3a72-abd2-4cea-b576-c038235b9101 None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:48.142463 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad3a72-abd2-4cea-b576-c038235b9101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:48.144534 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad3a72-abd2-4cea-b576-c038235b9101 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:48.146558 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8954742-c515-48b9-b547-a057314be6c9 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:48.146850 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8954742-c515-48b9-b547-a057314be6c9 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:48.147127 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8954742-c515-48b9-b547-a057314be6c9 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:48.148706 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 364/711] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:44:48.154800 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 348/712] 10.222.0.18 () {56 vars in 1087 bytes} [Mon May 2 08:44:47 2022] GET /identity/v3/services => generated 1002 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 08:44:48.154972 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f386e-ba50-4588-bcf1-ccfe86c98005 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:48.155617 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f386e-ba50-4588-bcf1-ccfe86c98005 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:48.156041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f386e-ba50-4588-bcf1-ccfe86c98005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:48.175802 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-d71f386e-ba50-4588-bcf1-ccfe86c98005 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:48.178092 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-d71f386e-ba50-4588-bcf1-ccfe86c98005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:48.257058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 365/713] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:48 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:44:48.282110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad3a72-abd2-4cea-b576-c038235b9101 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:48.388295 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad3a72-abd2-4cea-b576-c038235b9101 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:48.423591 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fb7fb-c3d3-4c1a-b9a3-083731003631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:48.424665 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fb7fb-c3d3-4c1a-b9a3-083731003631 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:48.425101 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fb7fb-c3d3-4c1a-b9a3-083731003631 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:48.425546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fb7fb-c3d3-4c1a-b9a3-083731003631 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:48.436677 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fb7fb-c3d3-4c1a-b9a3-083731003631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:44:48.444590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-426fb7fb-c3d3-4c1a-b9a3-083731003631 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:44:48.444590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:48.444590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:48.444590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:48.444590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:48.444590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:48.444590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:48.444590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:48.444590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:48.444590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:48.444590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:48.444590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:48.444590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:44:48.444590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:44:48.444590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:44:48.444590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:44:48.445753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:44:48.445753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:44:48.445753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:44:48.445753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:44:48.445753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:48.445753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:48.445753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:48.445753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:48.445753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:48.445753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:48.445753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:48.445753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:48.445753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:48.445753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:48.445753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:48.445753 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:48.447169 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:48.447169 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:48.447169 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:48.447169 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:48.447169 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:44:48.447169 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:44:48.447169 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:44:48.447169 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:44:48.447169 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:44:48.447169 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:44:48.447169 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:44:48.447169 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:48.449758 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 349/714] 10.222.0.18 () {56 vars in 1096 bytes} [Mon May 2 08:44:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:48.456566 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f386e-ba50-4588-bcf1-ccfe86c98005 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:48.555019 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f386e-ba50-4588-bcf1-ccfe86c98005 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:48.592865 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74886d05-c5ca-43fe-a5b2-bfc78f5458ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:48.593525 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74886d05-c5ca-43fe-a5b2-bfc78f5458ff None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:48.593804 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74886d05-c5ca-43fe-a5b2-bfc78f5458ff None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:48.594076 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74886d05-c5ca-43fe-a5b2-bfc78f5458ff None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:48.594815 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74886d05-c5ca-43fe-a5b2-bfc78f5458ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:48.595117 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74886d05-c5ca-43fe-a5b2-bfc78f5458ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:48.596519 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74886d05-c5ca-43fe-a5b2-bfc78f5458ff None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:48.605438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 366/715] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:44:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:48.611657 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fb7fb-c3d3-4c1a-b9a3-083731003631 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:48.714914 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fb7fb-c3d3-4c1a-b9a3-083731003631 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:48.749127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ef7f9-a352-41ec-91b7-0162a28114a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:48.749922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ef7f9-a352-41ec-91b7-0162a28114a1 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:48.750202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ef7f9-a352-41ec-91b7-0162a28114a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:48.750477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ef7f9-a352-41ec-91b7-0162a28114a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:48.761616 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ef7f9-a352-41ec-91b7-0162a28114a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:48.763706 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ef7f9-a352-41ec-91b7-0162a28114a1 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:48.781187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-dd4ef7f9-a352-41ec-91b7-0162a28114a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:48.781187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:48.781187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:48.781187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:48.781187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:48.781187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:48.781187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:48.781187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:48.781187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:48.781187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:48.781187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:48.781187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:48.781187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:48.781187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:48.781187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:48.782134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:48.782134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:48.782134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:48.782134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:48.782134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:48.782134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:48.782134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:48.782134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:48.782134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:48.782134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:48.782134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:48.782134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:48.782134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:48.782134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:48.782134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:48.782134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:48.782134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:48.783037 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:48.783037 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:48.783037 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:48.783037 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:48.783037 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 350/716] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:48.788236 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74886d05-c5ca-43fe-a5b2-bfc78f5458ff None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:48.892505 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74886d05-c5ca-43fe-a5b2-bfc78f5458ff None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:48.930003 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf1f68-19ad-4771-a825-79060509c65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:48.930674 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf1f68-19ad-4771-a825-79060509c65b None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:48.930952 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf1f68-19ad-4771-a825-79060509c65b None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:48.931223 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf1f68-19ad-4771-a825-79060509c65b None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:48.931942 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf1f68-19ad-4771-a825-79060509c65b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:48.932275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf1f68-19ad-4771-a825-79060509c65b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:48.933639 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf1f68-19ad-4771-a825-79060509c65b None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:48.946476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 367/717] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:48.952117 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ef7f9-a352-41ec-91b7-0162a28114a1 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:49.057153 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ef7f9-a352-41ec-91b7-0162a28114a1 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:49.090563 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af34e1-5eab-4034-9263-b03857827928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:49.091962 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af34e1-5eab-4034-9263-b03857827928 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:49.092352 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af34e1-5eab-4034-9263-b03857827928 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:49.092767 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af34e1-5eab-4034-9263-b03857827928 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:49.100805 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af34e1-5eab-4034-9263-b03857827928 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:49.102247 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af34e1-5eab-4034-9263-b03857827928 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:49.117083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-43af34e1-5eab-4034-9263-b03857827928 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 02 08:44:49.117083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:49.117083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:49.117083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:49.117083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:49.117083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:49.117083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:49.117083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:49.117083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:49.117083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:49.117083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:49.117083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:49.117083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:44:49.117083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:44:49.117083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:44:49.117083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:44:49.118981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:49.118981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:49.118981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:44:49.118981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:49.118981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:44:49.118981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:44:49.118981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:49.118981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:49.118981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:49.118981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:49.118981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:49.118981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:49.118981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:49.118981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:49.118981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:49.118981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:49.118981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:49.118981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:49.120226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:49.120226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:49.120226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:44:49.120226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:44:49.120226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:44:49.120226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:44:49.120226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:44:49.120226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:44:49.120226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 02 08:44:49.120226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:49.120226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 351/718] 10.222.0.18 () {56 vars in 1093 bytes} [Mon May 2 08:44:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:49.125361 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf1f68-19ad-4771-a825-79060509c65b None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:49.233733 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf1f68-19ad-4771-a825-79060509c65b None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:49.268603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919ce4f-4841-40c2-b890-394b7be1e80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:49.269265 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919ce4f-4841-40c2-b890-394b7be1e80f None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:49.269542 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919ce4f-4841-40c2-b890-394b7be1e80f None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:49.269813 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919ce4f-4841-40c2-b890-394b7be1e80f None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:49.270636 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919ce4f-4841-40c2-b890-394b7be1e80f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:49.270938 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919ce4f-4841-40c2-b890-394b7be1e80f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:49.272382 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919ce4f-4841-40c2-b890-394b7be1e80f None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:49.290463 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 368/719] 10.222.0.18 () {56 vars in 1133 bytes} [Mon May 2 08:44:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:49.297204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af34e1-5eab-4034-9263-b03857827928 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:49.386228 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5405842-d885-453c-9734-d0beb3ef1b8c None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:49.386434 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5405842-d885-453c-9734-d0beb3ef1b8c None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:49.386708 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5405842-d885-453c-9734-d0beb3ef1b8c None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:49.388055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 369/720] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:49.393782 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36a490-9133-4b88-a12e-5568c8e69172 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:49.394064 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36a490-9133-4b88-a12e-5568c8e69172 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:49.394334 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36a490-9133-4b88-a12e-5568c8e69172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:49.411228 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-4c36a490-9133-4b88-a12e-5568c8e69172 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:49.412571 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-4c36a490-9133-4b88-a12e-5568c8e69172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:49.416600 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af34e1-5eab-4034-9263-b03857827928 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:49.454600 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18591c6e-acf6-45b1-940d-95f3abf66d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:49.455720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18591c6e-acf6-45b1-940d-95f3abf66d6b None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:49.456245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18591c6e-acf6-45b1-940d-95f3abf66d6b None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:49.456740 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18591c6e-acf6-45b1-940d-95f3abf66d6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:49.492366 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 370/721] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:49 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 08:44:49.506759 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36a490-9133-4b88-a12e-5568c8e69172 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:49.528241 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18591c6e-acf6-45b1-940d-95f3abf66d6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:49.530985 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18591c6e-acf6-45b1-940d-95f3abf66d6b None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:49.602823 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36a490-9133-4b88-a12e-5568c8e69172 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:49.632200 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 352/722] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:49 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 08:44:49.644178 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b84e09-c47b-473c-bad6-4823e15f162c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:49.644178 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b84e09-c47b-473c-bad6-4823e15f162c None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:49.644178 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b84e09-c47b-473c-bad6-4823e15f162c None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:49.644526 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18591c6e-acf6-45b1-940d-95f3abf66d6b None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:49.644621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b84e09-c47b-473c-bad6-4823e15f162c None admin] PATH_INFO: `/v3/services/image` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:49.644621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b84e09-c47b-473c-bad6-4823e15f162c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:49.644621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b84e09-c47b-473c-bad6-4823e15f162c None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:49.651360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-08b84e09-c47b-473c-bad6-4823e15f162c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 02 08:44:49.651360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:49.651360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:44:49.651360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:44:49.651360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:44:49.651360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:44:49.651360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:44:49.651360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:49.651360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 02 08:44:49.651360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:49.651360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:44:49.651360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:49.651360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:49.651360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:49.651360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:49.651360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:49.651360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:49.652623 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:49.652623 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:49.652623 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:49.652623 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:49.652623 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:49.652623 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:49.652623 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:44:49.652623 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:44:49.652623 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:44:49.652623 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:44:49.652623 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:49.652623 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:49.652623 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:49.652623 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:49.652623 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:49.652623 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:49.653469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:49.653469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:49.653469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:49.653469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:49.653469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:49.653469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:49.653469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:49.653469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:49.653469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:49.653469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:49.653469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:44:49.653469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:49.653469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 02 08:44:49.653469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:49.656290 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 371/723] 10.222.0.18 () {56 vars in 1105 bytes} [Mon May 2 08:44:49 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:49.659214 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b84e09-c47b-473c-bad6-4823e15f162c None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:49.761059 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18591c6e-acf6-45b1-940d-95f3abf66d6b None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:49.761389 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b84e09-c47b-473c-bad6-4823e15f162c None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:49.802473 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230f62c-d591-40e0-8892-d9843a2645ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:49.803122 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230f62c-d591-40e0-8892-d9843a2645ad None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:49.803448 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230f62c-d591-40e0-8892-d9843a2645ad None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:49.803714 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4795d-b2cb-4ec1-b3ff-d085420595d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:49.803859 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230f62c-d591-40e0-8892-d9843a2645ad None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:49.804443 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230f62c-d591-40e0-8892-d9843a2645ad None admin] RBAC: Adding query filter params (name=image) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:49.804711 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4795d-b2cb-4ec1-b3ff-d085420595d9 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:49.804817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230f62c-d591-40e0-8892-d9843a2645ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:49.805092 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4795d-b2cb-4ec1-b3ff-d085420595d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:49.805476 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4795d-b2cb-4ec1-b3ff-d085420595d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:49.806085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230f62c-d591-40e0-8892-d9843a2645ad None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:49.816443 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 372/724] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:49.817514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230f62c-d591-40e0-8892-d9843a2645ad None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:49.822777 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4795d-b2cb-4ec1-b3ff-d085420595d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:49.824324 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4795d-b2cb-4ec1-b3ff-d085420595d9 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:49.850386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-25d4795d-b2cb-4ec1-b3ff-d085420595d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:49.850386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:49.850386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:49.850386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:49.850386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:49.850386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:49.850386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:49.850386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:49.850386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:49.850386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:49.850386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:49.850386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:49.850386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:49.850386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:49.850386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:49.851335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:49.851335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:49.851335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:49.851335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:49.851335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:49.851335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:49.851335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:49.851335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:49.851335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:49.851335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:49.851335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:49.851335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:49.851335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:49.851335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:49.851335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:49.851335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:49.851335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:49.852262 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:49.852262 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:49.852262 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:49.852262 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:49.852262 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 353/725] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:49.858483 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4795d-b2cb-4ec1-b3ff-d085420595d9 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:49.920737 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230f62c-d591-40e0-8892-d9843a2645ad None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:49.962698 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4d437-2878-479c-9e9d-a963588f591d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:49.963358 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4d437-2878-479c-9e9d-a963588f591d None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:49.963696 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4d437-2878-479c-9e9d-a963588f591d None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:49.964003 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4d437-2878-479c-9e9d-a963588f591d None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:49.964881 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4d437-2878-479c-9e9d-a963588f591d None admin] RBAC: Adding query filter params (type=image) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:49.965104 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4d437-2878-479c-9e9d-a963588f591d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:49.966989 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4d437-2878-479c-9e9d-a963588f591d None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:49.979097 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 373/726] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:49.980287 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4d437-2878-479c-9e9d-a963588f591d None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:49.995481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4795d-b2cb-4ec1-b3ff-d085420595d9 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:50.041415 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fcca4-c4e6-4155-8e1e-dfc4e18ce18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:50.042727 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fcca4-c4e6-4155-8e1e-dfc4e18ce18a None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:50.043381 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fcca4-c4e6-4155-8e1e-dfc4e18ce18a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:50.044224 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fcca4-c4e6-4155-8e1e-dfc4e18ce18a None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:50.045955 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fcca4-c4e6-4155-8e1e-dfc4e18ce18a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:50.046609 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fcca4-c4e6-4155-8e1e-dfc4e18ce18a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:50.048424 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fcca4-c4e6-4155-8e1e-dfc4e18ce18a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:50.069366 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 354/727] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:50.070413 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fcca4-c4e6-4155-8e1e-dfc4e18ce18a None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:50.091722 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4d437-2878-479c-9e9d-a963588f591d None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:50.127108 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef5dc9-9831-42a0-b3cf-b446693144a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:50.127790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef5dc9-9831-42a0-b3cf-b446693144a3 None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:50.128096 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef5dc9-9831-42a0-b3cf-b446693144a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:50.128487 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef5dc9-9831-42a0-b3cf-b446693144a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:50.129483 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef5dc9-9831-42a0-b3cf-b446693144a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:50.130587 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef5dc9-9831-42a0-b3cf-b446693144a3 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:50.189123 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fcca4-c4e6-4155-8e1e-dfc4e18ce18a None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:50.221936 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4ba25-40e4-4f9b-9ef9-15b2d0278c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:50.222788 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4ba25-40e4-4f9b-9ef9-15b2d0278c57 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:50.223023 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4ba25-40e4-4f9b-9ef9-15b2d0278c57 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:50.223278 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4ba25-40e4-4f9b-9ef9-15b2d0278c57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:50.229874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4ba25-40e4-4f9b-9ef9-15b2d0278c57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:50.231323 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4ba25-40e4-4f9b-9ef9-15b2d0278c57 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:50.245088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-90c4ba25-40e4-4f9b-9ef9-15b2d0278c57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:50.245088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:50.245088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:50.245088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:50.245088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:50.245088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:50.245088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:50.245088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:50.245088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:50.245088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:50.245088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:50.245088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:50.245088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:44:50.245088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:44:50.245088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:44:50.246233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:44:50.246233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:50.246233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:50.246233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:50.246233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:50.246233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:50.246233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:50.246233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:50.246233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:50.246233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:50.246233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:50.246233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:50.246233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:50.246233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:50.246233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:50.246233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:50.246233 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:50.247159 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:44:50.247159 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:44:50.247159 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:44:50.247159 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:44:50.247159 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:44:50.247159 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:44:50.247159 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:44:50.247159 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:50.247159 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 355/728] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:50.256294 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4ba25-40e4-4f9b-9ef9-15b2d0278c57 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:50.268263 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 374/729] 10.222.0.18 () {60 vars in 1144 bytes} [Mon May 2 08:44:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:44:50.376117 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4ba25-40e4-4f9b-9ef9-15b2d0278c57 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:50.426429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb479013-6414-49ac-b53a-c0b5567753cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:50.427946 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479013-6414-49ac-b53a-c0b5567753cb None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:50.428474 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479013-6414-49ac-b53a-c0b5567753cb None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:50.429106 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479013-6414-49ac-b53a-c0b5567753cb None admin] PATH_INFO: `/v3/projects` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:50.430196 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb479013-6414-49ac-b53a-c0b5567753cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:50.430774 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb479013-6414-49ac-b53a-c0b5567753cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:50.432521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb479013-6414-49ac-b53a-c0b5567753cb None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:50.447988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 356/730] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:44:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:50.454571 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef5dc9-9831-42a0-b3cf-b446693144a3 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:50.557957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef5dc9-9831-42a0-b3cf-b446693144a3 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:50.568489 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ed23b-0bff-4344-8a19-0ca93451dd92 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:50.569091 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ed23b-0bff-4344-8a19-0ca93451dd92 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:50.569570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ed23b-0bff-4344-8a19-0ca93451dd92 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:50.571124 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 357/731] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:50.577001 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c53a8-e9a9-4f8e-8847-ce1168f64c2a None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:50.577281 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c53a8-e9a9-4f8e-8847-ce1168f64c2a None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:50.577556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c53a8-e9a9-4f8e-8847-ce1168f64c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:50.594561 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-276c53a8-e9a9-4f8e-8847-ce1168f64c2a None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:50.595436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56501f9-8ca6-4999-831d-3398d91b75ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:50.595749 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-276c53a8-e9a9-4f8e-8847-ce1168f64c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:50.596543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56501f9-8ca6-4999-831d-3398d91b75ca None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:50.597039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56501f9-8ca6-4999-831d-3398d91b75ca None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:50.597498 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56501f9-8ca6-4999-831d-3398d91b75ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:50.598511 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56501f9-8ca6-4999-831d-3398d91b75ca None admin] RBAC: Adding query filter params (role.id=509216a314244b96b05d3fe56b0d9cd1, scope.project.id=758931ec3ed54a1eadf1b9a463fbb241, user.id=97308967556844019594cd0c4abc41fc) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:50.598832 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56501f9-8ca6-4999-831d-3398d91b75ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:50.600299 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56501f9-8ca6-4999-831d-3398d91b75ca None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:50.606436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 375/732] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:44:50 2022] GET /identity/v3/role_assignments?user.id=97308967556844019594cd0c4abc41fc&scope.project.id=758931ec3ed54a1eadf1b9a463fbb241&role.id=509216a314244b96b05d3fe56b0d9cd1 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:50.608004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904541d-9889-4cee-a193-38bcaa5a62c0 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:50.608335 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904541d-9889-4cee-a193-38bcaa5a62c0 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:50.608615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904541d-9889-4cee-a193-38bcaa5a62c0 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:50.610004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 376/733] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:50.615551 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0f9eb-5492-46be-9428-9db5b4bf372f None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:50.615835 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0f9eb-5492-46be-9428-9db5b4bf372f None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:50.616153 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0f9eb-5492-46be-9428-9db5b4bf372f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:50.634337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-6bf0f9eb-5492-46be-9428-9db5b4bf372f None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:50.635964 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-6bf0f9eb-5492-46be-9428-9db5b4bf372f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:50.716401 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 358/734] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:50 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 08:44:50.728388 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 377/735] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:50 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 08:44:50.741652 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c53a8-e9a9-4f8e-8847-ce1168f64c2a None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:50.756570 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0f9eb-5492-46be-9428-9db5b4bf372f None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:50.855885 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c53a8-e9a9-4f8e-8847-ce1168f64c2a None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:50.875727 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0f9eb-5492-46be-9428-9db5b4bf372f None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:50.895859 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d606f-c5e4-4b9e-81ea-b56522adac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:50.896692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d606f-c5e4-4b9e-81ea-b56522adac92 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:50.896977 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d606f-c5e4-4b9e-81ea-b56522adac92 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:50.897249 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d606f-c5e4-4b9e-81ea-b56522adac92 None admin] PATH_INFO: `/v3/services/network` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:50.897909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d606f-c5e4-4b9e-81ea-b56522adac92 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:50.899288 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d606f-c5e4-4b9e-81ea-b56522adac92 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:50.912693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-ef8d606f-c5e4-4b9e-81ea-b56522adac92 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 02 08:44:50.912693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:50.912693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:44:50.912693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:44:50.912693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:44:50.912693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:44:50.912693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:44:50.912693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:50.912693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 02 08:44:50.912693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:50.912693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:44:50.912693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:50.912693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:50.912693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:50.912693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:50.912693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:50.912693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:50.913722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:50.913722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:50.913722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:50.913722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:50.913722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:50.913722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:50.913722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:44:50.913722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:44:50.913722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:44:50.913722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:44:50.913722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:50.913722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:50.913722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:50.913722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:50.913722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:50.913722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:50.915007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:50.915007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:50.915007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:50.915007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:50.915007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:50.915007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:50.915007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:50.915007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:50.915007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:50.915007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:50.915007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:44:50.915007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:50.915007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 02 08:44:50.915007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:50.915007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 359/736] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:44:50 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:50.918720 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561df5fd-8815-4042-9857-2f7f3f56c61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:50.920424 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561df5fd-8815-4042-9857-2f7f3f56c61a None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:50.920750 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561df5fd-8815-4042-9857-2f7f3f56c61a None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:50.920963 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561df5fd-8815-4042-9857-2f7f3f56c61a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:50.921298 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d606f-c5e4-4b9e-81ea-b56522adac92 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:50.921618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561df5fd-8815-4042-9857-2f7f3f56c61a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:50.922992 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561df5fd-8815-4042-9857-2f7f3f56c61a None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:50.936420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-561df5fd-8815-4042-9857-2f7f3f56c61a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 02 08:44:50.936420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:50.936420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:44:50.936420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:44:50.936420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:44:50.936420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:44:50.936420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:44:50.936420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:50.936420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 02 08:44:50.936420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:50.936420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:44:50.936420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:50.936420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:50.936420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:50.936420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:50.936420 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:50.937407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:50.937407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:50.937407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:50.937407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:50.937407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:50.937407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:50.937407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:50.937407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:44:50.937407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:44:50.937407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:44:50.937407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:44:50.937407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:50.937407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:50.937407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:50.937407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:50.937407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:50.938275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:50.938275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:50.938275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:50.938275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:50.938275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:50.938275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:50.938275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:50.938275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:50.938275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:50.938275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:50.938275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:50.938275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:44:50.938275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:50.938275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 02 08:44:50.938275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:50.938275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 378/737] 10.222.0.18 () {56 vars in 1129 bytes} [Mon May 2 08:44:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:50.943673 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561df5fd-8815-4042-9857-2f7f3f56c61a None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:51.045774 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d606f-c5e4-4b9e-81ea-b56522adac92 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:51.068430 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561df5fd-8815-4042-9857-2f7f3f56c61a None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:51.082107 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150446a-f12a-4a11-a454-ed12ca74761a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:51.083091 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150446a-f12a-4a11-a454-ed12ca74761a None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:51.083583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150446a-f12a-4a11-a454-ed12ca74761a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:51.084130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150446a-f12a-4a11-a454-ed12ca74761a None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:51.085042 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150446a-f12a-4a11-a454-ed12ca74761a None admin] RBAC: Adding query filter params (name=network) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:51.085555 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150446a-f12a-4a11-a454-ed12ca74761a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:51.087131 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150446a-f12a-4a11-a454-ed12ca74761a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:51.097751 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 360/738] 10.222.0.18 () {56 vars in 1112 bytes} [Mon May 2 08:44:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:51.099037 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150446a-f12a-4a11-a454-ed12ca74761a None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:51.103749 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf9ddf-50e1-4983-8b52-20460410d97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:51.103980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf9ddf-50e1-4983-8b52-20460410d97f None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:51.104298 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf9ddf-50e1-4983-8b52-20460410d97f None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:51.104576 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf9ddf-50e1-4983-8b52-20460410d97f None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:51.105283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf9ddf-50e1-4983-8b52-20460410d97f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:51.105591 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf9ddf-50e1-4983-8b52-20460410d97f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:51.107486 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf9ddf-50e1-4983-8b52-20460410d97f None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:51.112729 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 379/739] 10.222.0.18 () {56 vars in 1124 bytes} [Mon May 2 08:44:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:51.118029 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf9ddf-50e1-4983-8b52-20460410d97f None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:51.204187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150446a-f12a-4a11-a454-ed12ca74761a None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:51.219260 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf9ddf-50e1-4983-8b52-20460410d97f None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:51.240186 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb61937-b5df-4f9c-9344-2903c2fb29a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:51.241176 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb61937-b5df-4f9c-9344-2903c2fb29a0 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:51.241690 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb61937-b5df-4f9c-9344-2903c2fb29a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:51.242159 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb61937-b5df-4f9c-9344-2903c2fb29a0 None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:51.242976 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb61937-b5df-4f9c-9344-2903c2fb29a0 None admin] RBAC: Adding query filter params (type=network) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:51.243413 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb61937-b5df-4f9c-9344-2903c2fb29a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:51.244923 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb61937-b5df-4f9c-9344-2903c2fb29a0 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:51.255056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 361/740] 10.222.0.18 () {56 vars in 1112 bytes} [Mon May 2 08:44:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:51.256236 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb61937-b5df-4f9c-9344-2903c2fb29a0 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:51.258233 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ade5c3-5065-403f-9323-6dae60702b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:51.259238 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ade5c3-5065-403f-9323-6dae60702b43 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:51.260499 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ade5c3-5065-403f-9323-6dae60702b43 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:51.260965 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ade5c3-5065-403f-9323-6dae60702b43 None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:51.261884 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ade5c3-5065-403f-9323-6dae60702b43 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:51.262340 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ade5c3-5065-403f-9323-6dae60702b43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:51.264118 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ade5c3-5065-403f-9323-6dae60702b43 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:51.277106 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 380/741] 10.222.0.18 () {56 vars in 1124 bytes} [Mon May 2 08:44:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:51.278264 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ade5c3-5065-403f-9323-6dae60702b43 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:51.364866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb61937-b5df-4f9c-9344-2903c2fb29a0 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:51.398112 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ade5c3-5065-403f-9323-6dae60702b43 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:51.406716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a73bc-91dd-4a0f-856a-dce86fa4c4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:51.407705 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a73bc-91dd-4a0f-856a-dce86fa4c4d3 None admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:51.408544 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a73bc-91dd-4a0f-856a-dce86fa4c4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:51.409011 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a73bc-91dd-4a0f-856a-dce86fa4c4d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:51.410372 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a73bc-91dd-4a0f-856a-dce86fa4c4d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:51.412399 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a73bc-91dd-4a0f-856a-dce86fa4c4d3 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:51.434041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e043d93-7ef1-4105-a012-d954b4b6706e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:51.440102 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e043d93-7ef1-4105-a012-d954b4b6706e None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:51.440102 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e043d93-7ef1-4105-a012-d954b4b6706e None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:51.440102 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e043d93-7ef1-4105-a012-d954b4b6706e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:51.440102 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e043d93-7ef1-4105-a012-d954b4b6706e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:51.440102 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e043d93-7ef1-4105-a012-d954b4b6706e None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:51.511001 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 362/742] 10.222.0.18 () {60 vars in 1144 bytes} [Mon May 2 08:44:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:44:51.535533 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 381/743] 10.222.0.18 () {60 vars in 1144 bytes} [Mon May 2 08:44:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 08:44:52.719161 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf34246-3e4d-44b2-99d0-6e9c31b70e9f None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:52.719724 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf34246-3e4d-44b2-99d0-6e9c31b70e9f None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:52.719724 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf34246-3e4d-44b2-99d0-6e9c31b70e9f None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:52.721192 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 363/744] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:52.726752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed8785-4739-4149-92d3-d8996d4cfb38 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:52.727171 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed8785-4739-4149-92d3-d8996d4cfb38 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:52.727341 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed8785-4739-4149-92d3-d8996d4cfb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:52.745131 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-50ed8785-4739-4149-92d3-d8996d4cfb38 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:52.746328 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-50ed8785-4739-4149-92d3-d8996d4cfb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:52.824364 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 382/745] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:52 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:44:52.849126 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf34246-3e4d-44b2-99d0-6e9c31b70e9f None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:52.949590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf34246-3e4d-44b2-99d0-6e9c31b70e9f None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:52.983137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b3445-dfdb-44ff-9ebc-f8a633a350a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:52.983957 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b3445-dfdb-44ff-9ebc-f8a633a350a9 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:52.984274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b3445-dfdb-44ff-9ebc-f8a633a350a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:52.984552 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b3445-dfdb-44ff-9ebc-f8a633a350a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:53.025426 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb20bb-2d2d-47b2-aac6-0e6712f1d977 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:53.025721 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb20bb-2d2d-47b2-aac6-0e6712f1d977 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:53.025990 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb20bb-2d2d-47b2-aac6-0e6712f1d977 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:53.027510 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 383/746] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:44:53.032855 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69671aa7-fcc9-4c2c-82da-5ff3019885af None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:53.033145 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69671aa7-fcc9-4c2c-82da-5ff3019885af None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:53.033428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69671aa7-fcc9-4c2c-82da-5ff3019885af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:53.053328 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-69671aa7-fcc9-4c2c-82da-5ff3019885af None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:53.054484 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-69671aa7-fcc9-4c2c-82da-5ff3019885af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:53.057520 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b3445-dfdb-44ff-9ebc-f8a633a350a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:53.058971 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b3445-dfdb-44ff-9ebc-f8a633a350a9 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:53.119142 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 384/747] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:53 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 08:44:53.142639 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69671aa7-fcc9-4c2c-82da-5ff3019885af None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:53.158618 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 364/748] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:44:52 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 08:44:53.164315 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b3445-dfdb-44ff-9ebc-f8a633a350a9 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:53.249975 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69671aa7-fcc9-4c2c-82da-5ff3019885af None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:53.261058 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b3445-dfdb-44ff-9ebc-f8a633a350a9 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:53.283024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23ee46-3d61-4a42-996a-273536c114e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:53.283830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23ee46-3d61-4a42-996a-273536c114e9 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:53.284149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23ee46-3d61-4a42-996a-273536c114e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:53.284423 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23ee46-3d61-4a42-996a-273536c114e9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:53.285066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23ee46-3d61-4a42-996a-273536c114e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:53.286428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23ee46-3d61-4a42-996a-273536c114e9 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:53.299055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-2e23ee46-3d61-4a42-996a-273536c114e9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 02 08:44:53.299055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:53.299055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:44:53.299055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:44:53.299055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:44:53.299055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:44:53.299055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:44:53.299055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:53.299055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 02 08:44:53.299055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:53.299055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:44:53.299055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:53.299055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:53.299055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:53.299055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:53.299055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:53.300002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:53.300002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:53.300002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:53.300002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:53.300002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:53.300002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:53.300002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:53.300002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:44:53.300002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:44:53.300002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:44:53.300002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:44:53.300002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:53.300002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:53.300002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:53.300002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:53.300002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:53.302156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:53.302156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:53.302156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:53.302156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:53.302156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:53.302156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:53.302156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:53.302156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:53.302156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:53.302156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:53.302156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:53.302156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:44:53.302156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:53.302156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 02 08:44:53.302156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:53.302156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 385/749] 10.222.0.18 () {56 vars in 1132 bytes} [Mon May 2 08:44:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:53.304629 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209361a-237a-42b6-b37f-1b96c82ba0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:53.305517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209361a-237a-42b6-b37f-1b96c82ba0de None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:53.305803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209361a-237a-42b6-b37f-1b96c82ba0de None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:53.306054 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23ee46-3d61-4a42-996a-273536c114e9 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:53.306159 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209361a-237a-42b6-b37f-1b96c82ba0de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:53.316959 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209361a-237a-42b6-b37f-1b96c82ba0de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:53.318196 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209361a-237a-42b6-b37f-1b96c82ba0de None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:53.337507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-0209361a-237a-42b6-b37f-1b96c82ba0de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:53.337507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:53.337507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:53.337507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:53.337507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:53.337507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:53.337507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:53.337507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:53.337507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:53.337507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:53.337507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:53.337507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:53.337507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:44:53.337507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:44:53.337507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:44:53.338734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:44:53.338734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:53.338734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:53.338734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:53.338734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:53.338734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:53.338734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:53.338734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:53.338734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:53.338734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:53.338734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:53.338734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:53.338734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:53.338734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:53.338734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:53.338734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:53.338734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:53.339632 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:44:53.339632 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:44:53.339632 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:44:53.339632 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:53.339632 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 365/750] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:44:53.346654 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209361a-237a-42b6-b37f-1b96c82ba0de None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:53.422190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23ee46-3d61-4a42-996a-273536c114e9 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:53.448214 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209361a-237a-42b6-b37f-1b96c82ba0de None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:53.461322 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3387f2-fae7-44fa-afa4-c2fba03916a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:53.461971 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3387f2-fae7-44fa-afa4-c2fba03916a5 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:53.462484 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3387f2-fae7-44fa-afa4-c2fba03916a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:53.462484 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3387f2-fae7-44fa-afa4-c2fba03916a5 None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:53.463237 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3387f2-fae7-44fa-afa4-c2fba03916a5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:53.463505 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3387f2-fae7-44fa-afa4-c2fba03916a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:53.464874 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3387f2-fae7-44fa-afa4-c2fba03916a5 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:53.469638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 386/751] 10.222.0.18 () {56 vars in 1126 bytes} [Mon May 2 08:44:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:53.475138 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3387f2-fae7-44fa-afa4-c2fba03916a5 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:53.482039 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34928aee-7e59-45a2-84bd-d963db91bcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:53.482907 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34928aee-7e59-45a2-84bd-d963db91bcff None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:53.483186 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34928aee-7e59-45a2-84bd-d963db91bcff None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:53.483456 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34928aee-7e59-45a2-84bd-d963db91bcff None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:53.484210 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34928aee-7e59-45a2-84bd-d963db91bcff None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:53.484520 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34928aee-7e59-45a2-84bd-d963db91bcff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:53.485899 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34928aee-7e59-45a2-84bd-d963db91bcff None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:53.497396 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 366/752] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:53.584106 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3387f2-fae7-44fa-afa4-c2fba03916a5 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:53.618209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1b66d-77f9-40b4-b85c-0e119bea2110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:53.618888 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1b66d-77f9-40b4-b85c-0e119bea2110 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:53.619171 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1b66d-77f9-40b4-b85c-0e119bea2110 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:53.619444 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1b66d-77f9-40b4-b85c-0e119bea2110 None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:53.620187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1b66d-77f9-40b4-b85c-0e119bea2110 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:53.620495 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1b66d-77f9-40b4-b85c-0e119bea2110 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:53.621896 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1b66d-77f9-40b4-b85c-0e119bea2110 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:53.632193 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 387/753] 10.222.0.18 () {56 vars in 1126 bytes} [Mon May 2 08:44:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:53.913877 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba87ee-39c3-49f8-8855-3047cac183d8 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:53.914410 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba87ee-39c3-49f8-8855-3047cac183d8 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:53.914499 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba87ee-39c3-49f8-8855-3047cac183d8 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:53.915777 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 367/754] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:53.921903 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8e831-75af-46c9-b761-9cfbddc32dfc None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:53.922419 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8e831-75af-46c9-b761-9cfbddc32dfc None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:53.922524 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8e831-75af-46c9-b761-9cfbddc32dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:53.939698 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-7bb8e831-75af-46c9-b761-9cfbddc32dfc None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:53.940900 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-7bb8e831-75af-46c9-b761-9cfbddc32dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:54.004952 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 388/755] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:53 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 08:44:54.028076 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba87ee-39c3-49f8-8855-3047cac183d8 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:54.124144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba87ee-39c3-49f8-8855-3047cac183d8 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:54.155366 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b84e0-e2a5-4dc1-84f1-1eddc8fa56d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:54.156182 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b84e0-e2a5-4dc1-84f1-1eddc8fa56d2 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:54.156464 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b84e0-e2a5-4dc1-84f1-1eddc8fa56d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:54.156734 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b84e0-e2a5-4dc1-84f1-1eddc8fa56d2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:54.157374 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b84e0-e2a5-4dc1-84f1-1eddc8fa56d2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:54.158738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b84e0-e2a5-4dc1-84f1-1eddc8fa56d2 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:54.170806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-808b84e0-e2a5-4dc1-84f1-1eddc8fa56d2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 02 08:44:54.170806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:54.170806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:44:54.170806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:44:54.170806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:44:54.170806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:44:54.170806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:44:54.170806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:54.170806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 02 08:44:54.170806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:54.170806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:44:54.170806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:54.170806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:54.170806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:54.170806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:54.170806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:54.170806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:54.171779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:54.171779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:54.171779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:54.171779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:54.171779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:54.171779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:54.171779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:44:54.171779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:44:54.171779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:44:54.171779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:44:54.171779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:54.171779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:54.171779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:54.171779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:54.171779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:54.171779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:54.172720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:54.172720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:54.172720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:54.172720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:54.172720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:54.172720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:54.172720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:54.172720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:54.172720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:54.172720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:54.172720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:44:54.172720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:54.172720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 02 08:44:54.172720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:54.172720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 368/756] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:44:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:54.177784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8e831-75af-46c9-b761-9cfbddc32dfc None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:54.270455 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8e831-75af-46c9-b761-9cfbddc32dfc None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:54.302168 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b371135-323f-4954-87c1-6d4047a0106d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:54.302815 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b371135-323f-4954-87c1-6d4047a0106d None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:54.303098 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b371135-323f-4954-87c1-6d4047a0106d None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:54.303372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b371135-323f-4954-87c1-6d4047a0106d None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:54.304100 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b371135-323f-4954-87c1-6d4047a0106d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:54.304406 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b371135-323f-4954-87c1-6d4047a0106d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:54.305761 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b371135-323f-4954-87c1-6d4047a0106d None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:54.310735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 389/757] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:44:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:54.316068 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b84e0-e2a5-4dc1-84f1-1eddc8fa56d2 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:54.410239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b84e0-e2a5-4dc1-84f1-1eddc8fa56d2 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:54.441865 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084522c1-de54-488f-a39b-38b06334afe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:54.442462 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084522c1-de54-488f-a39b-38b06334afe6 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:54.442743 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084522c1-de54-488f-a39b-38b06334afe6 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:54.443016 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084522c1-de54-488f-a39b-38b06334afe6 None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:54.443721 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084522c1-de54-488f-a39b-38b06334afe6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:54.444019 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084522c1-de54-488f-a39b-38b06334afe6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:54.445413 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084522c1-de54-488f-a39b-38b06334afe6 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:54.450004 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 369/758] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:44:54 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:55.920400 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc4aaf-81c5-4ba4-9b4e-a9a84daf740b None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:55.920913 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc4aaf-81c5-4ba4-9b4e-a9a84daf740b None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:55.920913 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc4aaf-81c5-4ba4-9b4e-a9a84daf740b None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:55.922196 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 390/759] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:55.927343 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769a254-6820-4324-82f6-5cfa8d475f44 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:55.927751 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769a254-6820-4324-82f6-5cfa8d475f44 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:55.928033 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769a254-6820-4324-82f6-5cfa8d475f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:55.946306 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-6769a254-6820-4324-82f6-5cfa8d475f44 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:55.947735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-6769a254-6820-4324-82f6-5cfa8d475f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:56.013240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 370/760] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:55 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:44:56.036179 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc4aaf-81c5-4ba4-9b4e-a9a84daf740b None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:56.132739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc4aaf-81c5-4ba4-9b4e-a9a84daf740b None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:56.163968 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf33477-2d05-429c-a5b9-48d77f77c9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:56.164648 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf33477-2d05-429c-a5b9-48d77f77c9eb None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:56.164924 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf33477-2d05-429c-a5b9-48d77f77c9eb None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:56.165193 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf33477-2d05-429c-a5b9-48d77f77c9eb None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:56.165894 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf33477-2d05-429c-a5b9-48d77f77c9eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:56.167247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf33477-2d05-429c-a5b9-48d77f77c9eb None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:56.251714 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 391/761] 10.222.0.18 () {60 vars in 1141 bytes} [Mon May 2 08:44:56 2022] POST /identity/v3/services => generated 269 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:44:56.754310 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca4ba3-e94e-4b4d-b751-b914e800daaf None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:56.754592 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca4ba3-e94e-4b4d-b751-b914e800daaf None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:56.754867 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca4ba3-e94e-4b4d-b751-b914e800daaf None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:56.756268 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 371/762] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:56.761516 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a6198-30f9-4243-992c-d6eb666baa62 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:56.761811 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a6198-30f9-4243-992c-d6eb666baa62 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:56.762090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a6198-30f9-4243-992c-d6eb666baa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:56.779377 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-6d3a6198-30f9-4243-992c-d6eb666baa62 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:56.780603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-6d3a6198-30f9-4243-992c-d6eb666baa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:56.849664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 392/763] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:56 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:44:56.873135 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca4ba3-e94e-4b4d-b751-b914e800daaf None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:56.968909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca4ba3-e94e-4b4d-b751-b914e800daaf None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:57.000209 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ab384-4d53-4d58-8efd-c47077b8536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:57.000865 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ab384-4d53-4d58-8efd-c47077b8536c None admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:57.001146 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ab384-4d53-4d58-8efd-c47077b8536c None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:57.001413 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ab384-4d53-4d58-8efd-c47077b8536c None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:57.002133 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ab384-4d53-4d58-8efd-c47077b8536c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:57.003492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ab384-4d53-4d58-8efd-c47077b8536c None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:57.092314 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 372/764] 10.222.0.18 () {60 vars in 1141 bytes} [Mon May 2 08:44:56 2022] POST /identity/v3/services => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:44:58.541170 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ddb56-18d9-4607-9225-ef5735eaddd6 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:58.541706 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ddb56-18d9-4607-9225-ef5735eaddd6 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:58.541706 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ddb56-18d9-4607-9225-ef5735eaddd6 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:58.543078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 393/765] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:58.549113 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7f800-7169-48ed-99fb-8fdcd333409a None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:58.549549 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7f800-7169-48ed-99fb-8fdcd333409a None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:58.549654 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7f800-7169-48ed-99fb-8fdcd333409a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:58.566381 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-b2b7f800-7169-48ed-99fb-8fdcd333409a None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:58.567527 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-b2b7f800-7169-48ed-99fb-8fdcd333409a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:58.635563 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 373/766] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:58 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:44:58.659355 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ddb56-18d9-4607-9225-ef5735eaddd6 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:58.756153 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ddb56-18d9-4607-9225-ef5735eaddd6 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:58.788352 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e633457-04a0-4308-a8b6-17e7c00e2c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:58.789155 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e633457-04a0-4308-a8b6-17e7c00e2c6b None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:58.789433 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e633457-04a0-4308-a8b6-17e7c00e2c6b None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:58.789703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e633457-04a0-4308-a8b6-17e7c00e2c6b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:58.790348 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e633457-04a0-4308-a8b6-17e7c00e2c6b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:58.791756 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e633457-04a0-4308-a8b6-17e7c00e2c6b None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:58.803629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-9e633457-04a0-4308-a8b6-17e7c00e2c6b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 02 08:44:58.803629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:58.803629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:44:58.803629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:44:58.803629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:44:58.803629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:44:58.803629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:44:58.803629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:58.803629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 02 08:44:58.803629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:58.803629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:44:58.803629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:58.803629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:58.803629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:58.803629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:58.803629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:58.804740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:58.804740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:58.804740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:58.804740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:58.804740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:58.804740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:58.804740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:58.804740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:44:58.804740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:44:58.804740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:44:58.804740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:44:58.804740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:58.804740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:58.804740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:58.804740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:58.804740 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:58.805980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:58.805980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:58.805980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:44:58.805980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:58.805980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:58.805980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:58.805980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:58.805980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:58.805980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:58.805980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:58.805980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:58.805980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:44:58.805980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:58.805980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 02 08:44:58.805980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:44:58.805980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 394/767] 10.222.0.18 () {56 vars in 1132 bytes} [Mon May 2 08:44:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:58.811376 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7f800-7169-48ed-99fb-8fdcd333409a None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:58.904354 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7f800-7169-48ed-99fb-8fdcd333409a None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:58.936414 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d266a8-39e3-4664-8b30-70cd6311968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:58.937077 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d266a8-39e3-4664-8b30-70cd6311968e None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:58.937359 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d266a8-39e3-4664-8b30-70cd6311968e None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:58.937633 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d266a8-39e3-4664-8b30-70cd6311968e None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:58.938336 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d266a8-39e3-4664-8b30-70cd6311968e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:58.938642 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d266a8-39e3-4664-8b30-70cd6311968e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:58.940021 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d266a8-39e3-4664-8b30-70cd6311968e None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:58.944689 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 374/768] 10.222.0.18 () {56 vars in 1126 bytes} [Mon May 2 08:44:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:58.951241 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e633457-04a0-4308-a8b6-17e7c00e2c6b None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:59.047510 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e633457-04a0-4308-a8b6-17e7c00e2c6b None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:59.079972 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c696ab8-9ab9-40b2-9e72-b9dc9bf5b5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:59.080654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c696ab8-9ab9-40b2-9e72-b9dc9bf5b5a3 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:59.080937 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c696ab8-9ab9-40b2-9e72-b9dc9bf5b5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:59.081210 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c696ab8-9ab9-40b2-9e72-b9dc9bf5b5a3 None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:59.081905 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c696ab8-9ab9-40b2-9e72-b9dc9bf5b5a3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:59.082212 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c696ab8-9ab9-40b2-9e72-b9dc9bf5b5a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:59.083569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c696ab8-9ab9-40b2-9e72-b9dc9bf5b5a3 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:59.088293 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 395/769] 10.222.0.18 () {56 vars in 1126 bytes} [Mon May 2 08:44:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:59.094071 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d266a8-39e3-4664-8b30-70cd6311968e None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:59.188746 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d266a8-39e3-4664-8b30-70cd6311968e None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:59.224875 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8efe5-8b7e-4ff6-85dc-f06c5ff9ef60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:59.225542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8efe5-8b7e-4ff6-85dc-f06c5ff9ef60 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:59.225824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8efe5-8b7e-4ff6-85dc-f06c5ff9ef60 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:59.226098 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8efe5-8b7e-4ff6-85dc-f06c5ff9ef60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:59.226892 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8efe5-8b7e-4ff6-85dc-f06c5ff9ef60 None admin] RBAC: Adding query filter params (interface=public, service_id=855118de829649698e30c508c7ae013f, region_id=RegionOne) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:59.227207 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8efe5-8b7e-4ff6-85dc-f06c5ff9ef60 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:59.228789 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8efe5-8b7e-4ff6-85dc-f06c5ff9ef60 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:59.235034 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 375/770] 10.222.0.18 () {56 vars in 1251 bytes} [Mon May 2 08:44:59 2022] GET /identity/v3/endpoints?service_id=855118de829649698e30c508c7ae013f&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:59.240664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c696ab8-9ab9-40b2-9e72-b9dc9bf5b5a3 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:59.335508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c696ab8-9ab9-40b2-9e72-b9dc9bf5b5a3 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:59.367613 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ef943-c3dd-4a21-8b08-ea2be96c6dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:59.368296 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ef943-c3dd-4a21-8b08-ea2be96c6dc7 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:59.368579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ef943-c3dd-4a21-8b08-ea2be96c6dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:59.368850 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ef943-c3dd-4a21-8b08-ea2be96c6dc7 None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:59.369530 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ef943-c3dd-4a21-8b08-ea2be96c6dc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:59.370895 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ef943-c3dd-4a21-8b08-ea2be96c6dc7 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:59.377651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 396/771] 10.222.0.18 () {56 vars in 1087 bytes} [Mon May 2 08:44:59 2022] GET /identity/v3/services => generated 1498 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 08:44:59.385883 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f20c2-9ffd-4eb3-bb69-ec9532c16a55 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:59.386168 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f20c2-9ffd-4eb3-bb69-ec9532c16a55 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:59.386445 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f20c2-9ffd-4eb3-bb69-ec9532c16a55 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:59.388087 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 376/772] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:44:59.393890 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce984b33-1822-4127-bc73-b2cd8f52e8d6 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:59.394184 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce984b33-1822-4127-bc73-b2cd8f52e8d6 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:59.394469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce984b33-1822-4127-bc73-b2cd8f52e8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:59.413452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-ce984b33-1822-4127-bc73-b2cd8f52e8d6 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:44:59.414882 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-ce984b33-1822-4127-bc73-b2cd8f52e8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:44:59.488457 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 397/773] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:44:59 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:44:59.512821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f20c2-9ffd-4eb3-bb69-ec9532c16a55 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:59.614748 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f20c2-9ffd-4eb3-bb69-ec9532c16a55 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:59.649746 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402e61d-2296-4e19-9c65-466f18b89b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:59.650543 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402e61d-2296-4e19-9c65-466f18b89b1b None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:59.650823 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402e61d-2296-4e19-9c65-466f18b89b1b None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:59.651099 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402e61d-2296-4e19-9c65-466f18b89b1b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:59.651745 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402e61d-2296-4e19-9c65-466f18b89b1b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:59.653155 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402e61d-2296-4e19-9c65-466f18b89b1b None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:59.665378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-2402e61d-2296-4e19-9c65-466f18b89b1b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 02 08:44:59.665378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:59.665378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:44:59.665378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:44:59.665378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:44:59.665378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:44:59.665378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:44:59.665378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:59.665378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 02 08:44:59.665378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:59.665378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:44:59.665378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:59.665378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:44:59.665378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:44:59.665378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:44:59.665378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:44:59.665378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:44:59.666562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:44:59.666562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:44:59.666562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:44:59.666562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:44:59.666562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:44:59.666562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:44:59.666562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:44:59.666562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:44:59.666562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:44:59.666562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:44:59.666562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:44:59.666562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:44:59.666562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:44:59.666562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:44:59.666562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:44:59.666562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:44:59.667440 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:44:59.667440 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:44:59.667440 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:44:59.667440 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:44:59.667440 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:44:59.667440 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:44:59.667440 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:44:59.667440 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:44:59.667440 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:44:59.667440 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:44:59.667440 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:44:59.667440 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:44:59.667440 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 02 08:44:59.667440 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:44:59.667440 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 377/774] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:44:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:44:59.672650 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce984b33-1822-4127-bc73-b2cd8f52e8d6 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:59.767291 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce984b33-1822-4127-bc73-b2cd8f52e8d6 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:59.799220 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddaba7-e539-4617-b45f-e154787595b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:59.799873 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddaba7-e539-4617-b45f-e154787595b2 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:59.800200 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddaba7-e539-4617-b45f-e154787595b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:59.800477 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddaba7-e539-4617-b45f-e154787595b2 None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:59.801171 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddaba7-e539-4617-b45f-e154787595b2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:59.801477 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddaba7-e539-4617-b45f-e154787595b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:59.802842 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddaba7-e539-4617-b45f-e154787595b2 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:59.807287 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 398/775] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:44:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:44:59.812992 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402e61d-2296-4e19-9c65-466f18b89b1b None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:44:59.907418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402e61d-2296-4e19-9c65-466f18b89b1b None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:44:59.937842 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e69028-0f51-4665-abd1-f53af13fc287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:44:59.938488 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e69028-0f51-4665-abd1-f53af13fc287 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:44:59.938769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e69028-0f51-4665-abd1-f53af13fc287 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:44:59.939043 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e69028-0f51-4665-abd1-f53af13fc287 None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:44:59.939735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e69028-0f51-4665-abd1-f53af13fc287 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:44:59.940065 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e69028-0f51-4665-abd1-f53af13fc287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:44:59.941434 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e69028-0f51-4665-abd1-f53af13fc287 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:44:59.945957 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 378/776] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:44:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:44:59.952570 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddaba7-e539-4617-b45f-e154787595b2 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:00.043651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddaba7-e539-4617-b45f-e154787595b2 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:00.075886 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8727ef-564f-4bb7-ac79-ef5e49cc1c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:00.076547 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8727ef-564f-4bb7-ac79-ef5e49cc1c87 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:00.076827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8727ef-564f-4bb7-ac79-ef5e49cc1c87 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:00.077096 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8727ef-564f-4bb7-ac79-ef5e49cc1c87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:00.077865 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8727ef-564f-4bb7-ac79-ef5e49cc1c87 None admin] RBAC: Adding query filter params (interface=public, service_id=1805212bee344645a7e6576df0bf61b4, region_id=RegionOne) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:45:00.078173 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8727ef-564f-4bb7-ac79-ef5e49cc1c87 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:00.079525 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8727ef-564f-4bb7-ac79-ef5e49cc1c87 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:00.084303 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 399/777] 10.222.0.18 () {56 vars in 1251 bytes} [Mon May 2 08:44:59 2022] GET /identity/v3/endpoints?service_id=1805212bee344645a7e6576df0bf61b4&interface=public®ion_id=RegionOne => generated 194 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:45:00.089797 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e69028-0f51-4665-abd1-f53af13fc287 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:00.183599 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e69028-0f51-4665-abd1-f53af13fc287 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:00.214726 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac30ca3-71ee-4ffa-9557-5014ec6bb9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:00.215382 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac30ca3-71ee-4ffa-9557-5014ec6bb9a5 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:00.215664 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac30ca3-71ee-4ffa-9557-5014ec6bb9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:00.215935 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac30ca3-71ee-4ffa-9557-5014ec6bb9a5 None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:00.217166 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac30ca3-71ee-4ffa-9557-5014ec6bb9a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:00.218536 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac30ca3-71ee-4ffa-9557-5014ec6bb9a5 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:00.236087 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 379/778] 10.222.0.18 () {56 vars in 1087 bytes} [Mon May 2 08:45:00 2022] GET /identity/v3/services => generated 1498 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 08:45:01.693880 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e054490-8250-4c0d-984f-9b7a9162a37e None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:01.694399 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e054490-8250-4c0d-984f-9b7a9162a37e None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:01.694491 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e054490-8250-4c0d-984f-9b7a9162a37e None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:01.695796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 400/779] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:45:01.701825 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95ed55-c9da-4f5d-b619-0743762488a2 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:01.702230 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95ed55-c9da-4f5d-b619-0743762488a2 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:01.702496 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95ed55-c9da-4f5d-b619-0743762488a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:01.718881 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-4d95ed55-c9da-4f5d-b619-0743762488a2 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:45:01.720076 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-4d95ed55-c9da-4f5d-b619-0743762488a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:45:01.785307 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 380/780] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:45:01 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:45:01.809302 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e054490-8250-4c0d-984f-9b7a9162a37e None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:01.910676 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e054490-8250-4c0d-984f-9b7a9162a37e None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:01.943890 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a395d4-be1d-49d6-bf86-3abbdec143d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:01.944723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a395d4-be1d-49d6-bf86-3abbdec143d5 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:01.945002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a395d4-be1d-49d6-bf86-3abbdec143d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:01.945273 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a395d4-be1d-49d6-bf86-3abbdec143d5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:01.945920 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a395d4-be1d-49d6-bf86-3abbdec143d5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:01.947574 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a395d4-be1d-49d6-bf86-3abbdec143d5 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:01.960438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-97a395d4-be1d-49d6-bf86-3abbdec143d5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 02 08:45:01.960438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:01.960438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:45:01.960438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:45:01.960438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:45:01.960438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:45:01.960438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:45:01.960438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:45:01.960438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 02 08:45:01.960438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:45:01.960438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:45:01.960438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:45:01.960438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:01.960438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:45:01.960438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:45:01.960438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:45:01.961598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:45:01.961598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:45:01.961598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:45:01.961598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:45:01.961598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:45:01.961598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:45:01.961598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:45:01.961598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:45:01.961598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:45:01.961598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:45:01.961598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:45:01.961598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:45:01.961598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:45:01.961598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:45:01.961598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:45:01.961598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:45:01.962436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:45:01.962436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:45:01.962436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:45:01.962436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:45:01.962436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:45:01.962436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:45:01.962436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:45:01.962436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:45:01.962436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:45:01.962436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:45:01.962436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:45:01.962436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:45:01.962436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:45:01.962436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 02 08:45:01.962436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:45:01.962436 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 401/781] 10.222.0.18 () {56 vars in 1132 bytes} [Mon May 2 08:45:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:45:01.967613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95ed55-c9da-4f5d-b619-0743762488a2 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:02.059313 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95ed55-c9da-4f5d-b619-0743762488a2 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:02.092134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e2dc9-a318-44fe-9949-fe7ea60c7cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:02.092786 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e2dc9-a318-44fe-9949-fe7ea60c7cf4 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:02.093067 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e2dc9-a318-44fe-9949-fe7ea60c7cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:02.093337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e2dc9-a318-44fe-9949-fe7ea60c7cf4 None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:02.094030 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e2dc9-a318-44fe-9949-fe7ea60c7cf4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:45:02.094332 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e2dc9-a318-44fe-9949-fe7ea60c7cf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:02.095706 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e2dc9-a318-44fe-9949-fe7ea60c7cf4 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:02.100386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 381/782] 10.222.0.18 () {56 vars in 1126 bytes} [Mon May 2 08:45:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:45:02.105818 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a395d4-be1d-49d6-bf86-3abbdec143d5 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:02.200234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a395d4-be1d-49d6-bf86-3abbdec143d5 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:02.231576 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb409f-429f-4e2c-8745-1523d402833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:02.232746 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb409f-429f-4e2c-8745-1523d402833b None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:02.233025 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb409f-429f-4e2c-8745-1523d402833b None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:02.233296 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb409f-429f-4e2c-8745-1523d402833b None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:02.233989 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb409f-429f-4e2c-8745-1523d402833b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:45:02.234294 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb409f-429f-4e2c-8745-1523d402833b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:02.235660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb409f-429f-4e2c-8745-1523d402833b None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:02.243229 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 402/783] 10.222.0.18 () {56 vars in 1126 bytes} [Mon May 2 08:45:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:45:02.249002 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e2dc9-a318-44fe-9949-fe7ea60c7cf4 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:02.347539 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e2dc9-a318-44fe-9949-fe7ea60c7cf4 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:02.382981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b54908-c6e7-4747-ac91-96aa22e371c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:02.383639 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b54908-c6e7-4747-ac91-96aa22e371c3 None admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:02.383924 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b54908-c6e7-4747-ac91-96aa22e371c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:02.384441 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b54908-c6e7-4747-ac91-96aa22e371c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:02.385184 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b54908-c6e7-4747-ac91-96aa22e371c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:02.386562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b54908-c6e7-4747-ac91-96aa22e371c3 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:02.527322 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28e070-1333-4aaf-9c1d-7d4142ff5675 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:02.527537 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28e070-1333-4aaf-9c1d-7d4142ff5675 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:02.527801 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28e070-1333-4aaf-9c1d-7d4142ff5675 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:02.529527 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 403/784] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:45:02.534438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a3218-a391-4000-81a2-5cba53031e4c None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:02.534717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a3218-a391-4000-81a2-5cba53031e4c None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:02.534988 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a3218-a391-4000-81a2-5cba53031e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:02.551290 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-117a3218-a391-4000-81a2-5cba53031e4c None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:45:02.552783 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-117a3218-a391-4000-81a2-5cba53031e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:45:02.554494 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 382/785] 10.222.0.18 () {60 vars in 1144 bytes} [Mon May 2 08:45:02 2022] POST /identity/v3/endpoints => generated 347 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 08:45:02.629932 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 404/786] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:45:02 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 08:45:02.655025 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b54908-c6e7-4747-ac91-96aa22e371c3 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:02.758144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b54908-c6e7-4747-ac91-96aa22e371c3 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:02.791132 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aace13a-27f1-4279-86cf-8e0a3b9cf7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:02.791851 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aace13a-27f1-4279-86cf-8e0a3b9cf7de None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:02.792209 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aace13a-27f1-4279-86cf-8e0a3b9cf7de None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:02.792486 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aace13a-27f1-4279-86cf-8e0a3b9cf7de None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:02.793138 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aace13a-27f1-4279-86cf-8e0a3b9cf7de None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:02.795086 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aace13a-27f1-4279-86cf-8e0a3b9cf7de None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:02.806613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-2aace13a-27f1-4279-86cf-8e0a3b9cf7de None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 02 08:45:02.806613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:02.806613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:45:02.806613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:45:02.806613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:45:02.806613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:45:02.806613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:45:02.806613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:45:02.806613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 02 08:45:02.806613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:45:02.806613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:45:02.806613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:45:02.806613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:02.806613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:45:02.806613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:45:02.806613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:45:02.806613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:45:02.814418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:45:02.814418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:45:02.814418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:45:02.814418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:45:02.814418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:45:02.814418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:45:02.814418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:45:02.814418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:45:02.814418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:45:02.814418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:45:02.814418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:45:02.814418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:45:02.814418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:45:02.814418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:45:02.814418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:45:02.814418 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:45:02.815584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:45:02.815584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:45:02.815584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:45:02.815584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:45:02.815584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:45:02.815584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:45:02.815584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:45:02.815584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:45:02.815584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:45:02.815584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:45:02.815584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:45:02.815584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:45:02.815584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 02 08:45:02.815584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:45:02.815584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 383/787] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:45:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:45:02.816720 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a3218-a391-4000-81a2-5cba53031e4c None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:02.914553 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a3218-a391-4000-81a2-5cba53031e4c None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:02.947453 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea9e23-0055-4a87-b544-10d3600966e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:02.948139 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea9e23-0055-4a87-b544-10d3600966e5 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:02.948423 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea9e23-0055-4a87-b544-10d3600966e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:02.948697 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea9e23-0055-4a87-b544-10d3600966e5 None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:02.949402 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea9e23-0055-4a87-b544-10d3600966e5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:45:02.949700 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea9e23-0055-4a87-b544-10d3600966e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:02.951213 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea9e23-0055-4a87-b544-10d3600966e5 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:02.960182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 405/788] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:45:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:45:02.961420 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aace13a-27f1-4279-86cf-8e0a3b9cf7de None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:03.056105 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aace13a-27f1-4279-86cf-8e0a3b9cf7de None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:03.087337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c71047-95be-45ad-a509-b2c39926e534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:03.087988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c71047-95be-45ad-a509-b2c39926e534 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:03.088297 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c71047-95be-45ad-a509-b2c39926e534 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:03.088569 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c71047-95be-45ad-a509-b2c39926e534 None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:03.089260 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c71047-95be-45ad-a509-b2c39926e534 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:45:03.089563 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c71047-95be-45ad-a509-b2c39926e534 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:03.090935 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c71047-95be-45ad-a509-b2c39926e534 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:03.095633 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 384/789] 10.222.0.18 () {56 vars in 1114 bytes} [Mon May 2 08:45:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:45:03.101195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea9e23-0055-4a87-b544-10d3600966e5 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:03.194491 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea9e23-0055-4a87-b544-10d3600966e5 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:03.226114 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34551a2-5f60-4954-af5f-b507ac170efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:03.226753 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34551a2-5f60-4954-af5f-b507ac170efd None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:03.227029 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34551a2-5f60-4954-af5f-b507ac170efd None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:03.227300 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34551a2-5f60-4954-af5f-b507ac170efd None admin] PATH_INFO: `/v3/endpoints` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:03.228025 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34551a2-5f60-4954-af5f-b507ac170efd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:03.229395 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34551a2-5f60-4954-af5f-b507ac170efd None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:03.333687 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 406/790] 10.222.0.18 () {60 vars in 1144 bytes} [Mon May 2 08:45:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:45:04.944250 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5563c3a-6203-4b4c-8d61-2bd2dff58c78 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:04.944750 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5563c3a-6203-4b4c-8d61-2bd2dff58c78 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:04.944750 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5563c3a-6203-4b4c-8d61-2bd2dff58c78 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:04.946079 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 385/791] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:45:04.951633 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e739c-f165-4ea2-b367-3bbca2417401 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:04.952035 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e739c-f165-4ea2-b367-3bbca2417401 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:04.952220 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e739c-f165-4ea2-b367-3bbca2417401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:04.969185 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-5b7e739c-f165-4ea2-b367-3bbca2417401 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:45:04.970348 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-5b7e739c-f165-4ea2-b367-3bbca2417401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:45:05.038649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 407/792] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:45:04 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:45:05.061681 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5563c3a-6203-4b4c-8d61-2bd2dff58c78 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:05.159036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5563c3a-6203-4b4c-8d61-2bd2dff58c78 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:05.191430 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7dcfd-e400-4b79-8422-b0a5887247bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:05.192260 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7dcfd-e400-4b79-8422-b0a5887247bf None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:05.192544 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7dcfd-e400-4b79-8422-b0a5887247bf None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:05.192817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7dcfd-e400-4b79-8422-b0a5887247bf None admin] PATH_INFO: `/v3/services/compute` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:05.193462 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7dcfd-e400-4b79-8422-b0a5887247bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:05.194889 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7dcfd-e400-4b79-8422-b0a5887247bf None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:05.206638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-7ce7dcfd-e400-4b79-8422-b0a5887247bf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 02 08:45:05.206638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:05.206638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:45:05.206638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:45:05.206638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:45:05.206638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:45:05.206638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:45:05.206638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:45:05.206638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 02 08:45:05.206638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:45:05.206638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:45:05.206638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:45:05.206638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:05.206638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:45:05.206638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:45:05.206638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:45:05.206638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:45:05.207624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:45:05.207624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:45:05.207624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:45:05.207624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:45:05.207624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:45:05.207624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:45:05.207624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:45:05.207624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:45:05.207624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:45:05.207624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:45:05.207624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:45:05.207624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:45:05.207624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:45:05.207624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:45:05.207624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:45:05.207624 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:45:05.208518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:45:05.208518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:45:05.208518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:45:05.208518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:45:05.208518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:45:05.208518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:45:05.208518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:45:05.208518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:45:05.208518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:45:05.208518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:45:05.208518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:45:05.208518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:45:05.208518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 02 08:45:05.208518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:45:05.208518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 386/793] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:45:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:45:05.213745 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e739c-f165-4ea2-b367-3bbca2417401 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:05.308450 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e739c-f165-4ea2-b367-3bbca2417401 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:05.341275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade0111-c9ce-4ceb-be64-f59348c15be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:05.341932 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade0111-c9ce-4ceb-be64-f59348c15be7 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:05.342217 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade0111-c9ce-4ceb-be64-f59348c15be7 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:05.342491 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade0111-c9ce-4ceb-be64-f59348c15be7 None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:05.343186 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade0111-c9ce-4ceb-be64-f59348c15be7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:45:05.343493 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade0111-c9ce-4ceb-be64-f59348c15be7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:05.344891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade0111-c9ce-4ceb-be64-f59348c15be7 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:05.349499 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 408/794] 10.222.0.18 () {56 vars in 1112 bytes} [Mon May 2 08:45:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:45:05.354972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7dcfd-e400-4b79-8422-b0a5887247bf None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:05.451981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7dcfd-e400-4b79-8422-b0a5887247bf None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:05.488627 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e8423-c652-466b-81f4-6809655b6271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:05.489288 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e8423-c652-466b-81f4-6809655b6271 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:05.489571 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e8423-c652-466b-81f4-6809655b6271 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:05.489845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e8423-c652-466b-81f4-6809655b6271 None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:05.490576 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e8423-c652-466b-81f4-6809655b6271 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:45:05.490882 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e8423-c652-466b-81f4-6809655b6271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:05.492443 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e8423-c652-466b-81f4-6809655b6271 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:05.496845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 387/795] 10.222.0.18 () {56 vars in 1112 bytes} [Mon May 2 08:45:05 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:45:05.645125 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df15a6-7ce9-419a-92bf-5b1904b80275 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:05.645413 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df15a6-7ce9-419a-92bf-5b1904b80275 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:05.645690 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df15a6-7ce9-419a-92bf-5b1904b80275 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:05.647053 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 409/796] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:45:05.652709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b352bb-1215-4878-8620-08fb2c154151 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:05.652999 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b352bb-1215-4878-8620-08fb2c154151 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:05.653278 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b352bb-1215-4878-8620-08fb2c154151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:05.670651 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-33b352bb-1215-4878-8620-08fb2c154151 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:45:05.671880 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-33b352bb-1215-4878-8620-08fb2c154151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:45:05.736518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 388/797] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:45:05 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:45:05.761037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df15a6-7ce9-419a-92bf-5b1904b80275 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:05.857665 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df15a6-7ce9-419a-92bf-5b1904b80275 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:05.889881 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38eff26-b982-4f1b-911e-48b30ca04b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:05.890527 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38eff26-b982-4f1b-911e-48b30ca04b87 None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:05.890809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38eff26-b982-4f1b-911e-48b30ca04b87 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:05.891083 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38eff26-b982-4f1b-911e-48b30ca04b87 None admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:05.891780 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38eff26-b982-4f1b-911e-48b30ca04b87 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:05.893236 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38eff26-b982-4f1b-911e-48b30ca04b87 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:05.894591 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: WARNING keystone.server.flask.common [None req-d38eff26-b982-4f1b-911e-48b30ca04b87 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 02 08:45:05.936554 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.sql.core [None req-d38eff26-b982-4f1b-911e-48b30ca04b87 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 02 08:45:05.936554 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 02 08:45:05.936554 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [parameters: {'id': 'e053bd0989bb44f09cf82f080116ac50', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 02 08:45:05.936554 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93340) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 02 08:45:05.953532 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-d38eff26-b982-4f1b-911e-48b30ca04b87 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e053bd0989bb44f09cf82f080116ac50.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e053bd0989bb44f09cf82f080116ac50. May 02 08:45:05.953532 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:05.953532 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 02 08:45:05.953532 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self.dialect.do_execute( May 02 08:45:05.953532 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 02 08:45:05.953532 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 02 08:45:05.953532 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 02 08:45:05.953532 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application result = self._query(query) May 02 08:45:05.953532 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 02 08:45:05.953532 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application conn.query(q) May 02 08:45:05.953532 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 02 08:45:05.953532 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 02 08:45:05.953532 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 02 08:45:05.954829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application result.read() May 02 08:45:05.954829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 02 08:45:05.954829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 02 08:45:05.954829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 02 08:45:05.954829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application packet.raise_for_error() May 02 08:45:05.954829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 02 08:45:05.954829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 02 08:45:05.954829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 02 08:45:05.954829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 02 08:45:05.954829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 02 08:45:05.954829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:45:05.954829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 02 08:45:05.954829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:45:05.954829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:05.954829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 02 08:45:05.954829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 02 08:45:05.954829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 02 08:45:05.954829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return project_ref.to_dict() May 02 08:45:05.955785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 02 08:45:05.955785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application next(self.gen) May 02 08:45:05.955785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 02 08:45:05.955785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application yield resource May 02 08:45:05.955785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 02 08:45:05.955785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application next(self.gen) May 02 08:45:05.955785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 02 08:45:05.955785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self.session.rollback() May 02 08:45:05.955785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 02 08:45:05.955785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self.force_reraise() May 02 08:45:05.955785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 02 08:45:05.955785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise self.value May 02 08:45:05.955785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 02 08:45:05.955785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 02 08:45:05.955785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 02 08:45:05.955785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application session.commit() May 02 08:45:05.955785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 02 08:45:05.956781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 02 08:45:05.956781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 02 08:45:05.956781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._prepare_impl() May 02 08:45:05.956781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 02 08:45:05.956781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self.session.flush() May 02 08:45:05.956781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 02 08:45:05.956781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._flush(objects) May 02 08:45:05.956781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 02 08:45:05.956781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 02 08:45:05.956781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 02 08:45:05.956781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application compat.raise_( May 02 08:45:05.956781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 02 08:45:05.956781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception May 02 08:45:05.956781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 02 08:45:05.956781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application flush_context.execute() May 02 08:45:05.956781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 02 08:45:05.956781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rec.execute(self) May 02 08:45:05.957735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 02 08:45:05.957735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 02 08:45:05.957735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 02 08:45:05.957735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application _emit_insert_statements( May 02 08:45:05.957735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 02 08:45:05.957735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application c = connection._execute_20( May 02 08:45:05.957735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 02 08:45:05.957735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 02 08:45:05.957735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 02 08:45:05.957735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 02 08:45:05.957735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 02 08:45:05.957735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ret = self._execute_context( May 02 08:45:05.957735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 02 08:45:05.957735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 02 08:45:05.957735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 02 08:45:05.958578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 02 08:45:05.958578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 02 08:45:05.958578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception May 02 08:45:05.958578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 02 08:45:05.958578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self.dialect.do_execute( May 02 08:45:05.958578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 02 08:45:05.958578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 02 08:45:05.958578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 02 08:45:05.958578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application result = self._query(query) May 02 08:45:05.958578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 02 08:45:05.958578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application conn.query(q) May 02 08:45:05.958578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 02 08:45:05.958578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 02 08:45:05.958578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 02 08:45:05.958578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application result.read() May 02 08:45:05.958578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 02 08:45:05.958578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 02 08:45:05.959440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 02 08:45:05.959440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application packet.raise_for_error() May 02 08:45:05.959440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 02 08:45:05.959440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 02 08:45:05.959440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 02 08:45:05.959440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 02 08:45:05.959440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 02 08:45:05.959440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 02 08:45:05.959440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [parameters: {'id': 'e053bd0989bb44f09cf82f080116ac50', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 02 08:45:05.959440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 02 08:45:05.959440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:45:05.959440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:45:05.959440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:45:05.959440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:05.959440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 02 08:45:05.961655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 02 08:45:05.961655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 02 08:45:05.961655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 02 08:45:05.961655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 02 08:45:05.961655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:45:05.961655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:45:05.961655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:45:05.961655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:05.961655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:45:05.961655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:45:05.961655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:45:05.961655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:45:05.961655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:45:05.961655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:45:05.961655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:45:05.961655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:45:05.961655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:45:05.963325 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:45:05.963325 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 02 08:45:05.963325 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 02 08:45:05.963325 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:45:05.963325 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:45:05.963325 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 02 08:45:05.963325 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.Conflict( May 02 08:45:05.963325 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e053bd0989bb44f09cf82f080116ac50. May 02 08:45:05.963325 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:45:05.963325 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 410/798] 10.222.0.18 () {60 vars in 1140 bytes} [Mon May 2 08:45:05 2022] POST /identity/v3/projects => generated 262 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 02 08:45:05.964124 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b352bb-1215-4878-8620-08fb2c154151 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:06.056514 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b352bb-1215-4878-8620-08fb2c154151 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:06.088314 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f72fa-b59c-4adb-b04b-3269927b60e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:06.089098 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f72fa-b59c-4adb-b04b-3269927b60e2 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:06.089380 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f72fa-b59c-4adb-b04b-3269927b60e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:06.089653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f72fa-b59c-4adb-b04b-3269927b60e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:06.096693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f72fa-b59c-4adb-b04b-3269927b60e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:06.098139 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f72fa-b59c-4adb-b04b-3269927b60e2 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:06.111478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-ea0f72fa-b59c-4adb-b04b-3269927b60e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:45:06.111478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:06.111478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:45:06.111478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:45:06.111478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:45:06.111478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:45:06.111478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:45:06.111478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:45:06.111478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:45:06.111478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:45:06.111478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:45:06.111478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:45:06.111478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:45:06.111478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:45:06.111478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:45:06.112570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:45:06.112570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:45:06.112570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:45:06.112570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:45:06.112570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:45:06.112570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:45:06.112570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:45:06.112570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:45:06.112570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:45:06.112570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:45:06.112570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:45:06.112570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:45:06.112570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:45:06.112570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:45:06.112570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:45:06.112570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:45:06.112570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:45:06.113599 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:45:06.113599 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:45:06.113599 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:45:06.113599 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:45:06.113599 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:45:06.113599 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:45:06.113599 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:45:06.113599 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:45:06.113599 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 389/799] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:45:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:45:06.118579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38eff26-b982-4f1b-911e-48b30ca04b87 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:06.213705 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38eff26-b982-4f1b-911e-48b30ca04b87 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:06.245974 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5b455-7791-49b5-b30d-83e2fb335782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:06.246622 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5b455-7791-49b5-b30d-83e2fb335782 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:06.246901 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5b455-7791-49b5-b30d-83e2fb335782 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:06.247680 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5b455-7791-49b5-b30d-83e2fb335782 None admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:06.248457 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5b455-7791-49b5-b30d-83e2fb335782 None admin] RBAC: Adding query filter params (name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:45:06.248761 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5b455-7791-49b5-b30d-83e2fb335782 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:06.250377 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5b455-7791-49b5-b30d-83e2fb335782 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:06.269938 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 411/800] 10.222.0.18 () {56 vars in 1112 bytes} [Mon May 2 08:45:06 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:45:07.778892 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6f203-d4e7-4bcf-b5ed-f57e97ff1613 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:07.779451 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6f203-d4e7-4bcf-b5ed-f57e97ff1613 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:07.779545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6f203-d4e7-4bcf-b5ed-f57e97ff1613 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:07.780889 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 390/801] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:45:07.786198 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc25878-fe50-412c-91f9-1d32cc6ea344 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:07.786576 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc25878-fe50-412c-91f9-1d32cc6ea344 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:07.786752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc25878-fe50-412c-91f9-1d32cc6ea344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:07.803544 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-adc25878-fe50-412c-91f9-1d32cc6ea344 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:45:07.805058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-adc25878-fe50-412c-91f9-1d32cc6ea344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:45:07.869826 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 412/802] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:45:07 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:45:07.899614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6f203-d4e7-4bcf-b5ed-f57e97ff1613 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:07.997488 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6f203-d4e7-4bcf-b5ed-f57e97ff1613 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:08.029412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035322a4-30ad-4afe-9293-248bf7c44e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:08.030073 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035322a4-30ad-4afe-9293-248bf7c44e2c None admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:08.030354 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035322a4-30ad-4afe-9293-248bf7c44e2c None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:08.030626 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035322a4-30ad-4afe-9293-248bf7c44e2c None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:08.031343 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035322a4-30ad-4afe-9293-248bf7c44e2c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:08.032820 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035322a4-30ad-4afe-9293-248bf7c44e2c None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:08.081657 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 391/803] 10.222.0.18 () {60 vars in 1141 bytes} [Mon May 2 08:45:07 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 08:45:08.606362 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf81cf-d874-4ea5-a2c3-7da28982674d None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:08.606720 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf81cf-d874-4ea5-a2c3-7da28982674d None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:08.607000 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf81cf-d874-4ea5-a2c3-7da28982674d None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:08.608405 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 413/804] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:45:08.613731 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0717808-9dc0-4b04-a318-ba87b783a2f9 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:08.614034 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0717808-9dc0-4b04-a318-ba87b783a2f9 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:08.614316 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0717808-9dc0-4b04-a318-ba87b783a2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:08.630877 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-f0717808-9dc0-4b04-a318-ba87b783a2f9 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:45:08.632072 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-f0717808-9dc0-4b04-a318-ba87b783a2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:45:08.706949 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 392/805] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:45:08 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:45:08.733565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf81cf-d874-4ea5-a2c3-7da28982674d None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:08.829511 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf81cf-d874-4ea5-a2c3-7da28982674d None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:08.861662 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30efc3c-9ee0-448e-bd0c-d9af87b4b61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:08.862248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30efc3c-9ee0-448e-bd0c-d9af87b4b61a None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:08.862525 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30efc3c-9ee0-448e-bd0c-d9af87b4b61a None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:08.862793 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30efc3c-9ee0-448e-bd0c-d9af87b4b61a None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:08.863491 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30efc3c-9ee0-448e-bd0c-d9af87b4b61a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:08.865669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30efc3c-9ee0-448e-bd0c-d9af87b4b61a None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:08.905337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.sql.core [None req-a30efc3c-9ee0-448e-bd0c-d9af87b4b61a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 02 08:45:08.905337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 02 08:45:08.905337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [parameters: {'user_id': '11b21b2e110e4e9db4a0e4a034499365', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 02 08:45:08.905337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93340) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 02 08:45:08.912664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-a30efc3c-9ee0-448e-bd0c-d9af87b4b61a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 02 08:45:08.912664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:08.912664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 02 08:45:08.912664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self.dialect.do_execute( May 02 08:45:08.912664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 02 08:45:08.912664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 02 08:45:08.912664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 02 08:45:08.912664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application result = self._query(query) May 02 08:45:08.912664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 02 08:45:08.912664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application conn.query(q) May 02 08:45:08.912664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 02 08:45:08.912664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 02 08:45:08.912664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 02 08:45:08.912664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application result.read() May 02 08:45:08.912664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 02 08:45:08.913711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 02 08:45:08.913711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 02 08:45:08.913711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application packet.raise_for_error() May 02 08:45:08.913711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 02 08:45:08.913711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 02 08:45:08.913711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 02 08:45:08.913711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 02 08:45:08.913711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 02 08:45:08.913711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:45:08.913711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 02 08:45:08.913711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:45:08.913711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:08.913711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 02 08:45:08.913711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 02 08:45:08.913711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 02 08:45:08.913711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 02 08:45:08.913711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 02 08:45:08.913711 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application next(self.gen) May 02 08:45:08.914710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 02 08:45:08.914710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application yield resource May 02 08:45:08.914710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 02 08:45:08.914710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application next(self.gen) May 02 08:45:08.914710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 02 08:45:08.914710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self.session.rollback() May 02 08:45:08.914710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 02 08:45:08.914710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self.force_reraise() May 02 08:45:08.914710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 02 08:45:08.914710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise self.value May 02 08:45:08.914710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 02 08:45:08.914710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 02 08:45:08.914710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 02 08:45:08.914710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application session.commit() May 02 08:45:08.914710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 02 08:45:08.914710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 02 08:45:08.914710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 02 08:45:08.915597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._prepare_impl() May 02 08:45:08.915597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 02 08:45:08.915597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self.session.flush() May 02 08:45:08.915597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 02 08:45:08.915597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._flush(objects) May 02 08:45:08.915597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 02 08:45:08.915597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 02 08:45:08.915597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 02 08:45:08.915597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application compat.raise_( May 02 08:45:08.915597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 02 08:45:08.915597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception May 02 08:45:08.915597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 02 08:45:08.915597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application flush_context.execute() May 02 08:45:08.915597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 02 08:45:08.915597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rec.execute(self) May 02 08:45:08.915597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 02 08:45:08.915597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 02 08:45:08.916513 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 02 08:45:08.916513 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application _emit_insert_statements( May 02 08:45:08.916513 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 02 08:45:08.916513 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application result = connection._execute_20( May 02 08:45:08.916513 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 02 08:45:08.916513 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 02 08:45:08.916513 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 02 08:45:08.916513 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 02 08:45:08.916513 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 02 08:45:08.916513 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ret = self._execute_context( May 02 08:45:08.916513 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 02 08:45:08.916513 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 02 08:45:08.916513 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 02 08:45:08.916513 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 02 08:45:08.916513 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 02 08:45:08.916513 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception May 02 08:45:08.917356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 02 08:45:08.917356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self.dialect.do_execute( May 02 08:45:08.917356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 02 08:45:08.917356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 02 08:45:08.917356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 02 08:45:08.917356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application result = self._query(query) May 02 08:45:08.917356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 02 08:45:08.917356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application conn.query(q) May 02 08:45:08.917356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 02 08:45:08.917356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 02 08:45:08.917356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 02 08:45:08.917356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application result.read() May 02 08:45:08.917356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 02 08:45:08.917356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 02 08:45:08.917356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 02 08:45:08.917356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application packet.raise_for_error() May 02 08:45:08.918187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 02 08:45:08.918187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 02 08:45:08.918187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 02 08:45:08.918187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 02 08:45:08.918187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 02 08:45:08.918187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 02 08:45:08.918187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [parameters: {'user_id': '11b21b2e110e4e9db4a0e4a034499365', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 02 08:45:08.918187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 02 08:45:08.918187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:45:08.918187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:45:08.918187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:45:08.918187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:08.918187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:45:08.918187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:45:08.918187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:45:08.922629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:45:08.922629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:45:08.922629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:45:08.922629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:45:08.922629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:45:08.922629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:45:08.922629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:45:08.922629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 02 08:45:08.922629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 02 08:45:08.922629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:45:08.922629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:45:08.922629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:45:08.922629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:45:08.922629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:45:08.922629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:45:08.922629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 02 08:45:08.922629 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 02 08:45:08.923808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 02 08:45:08.923808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 02 08:45:08.923808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 02 08:45:08.923808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 02 08:45:08.923808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 02 08:45:08.923808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:45:08.923808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 414/806] 10.222.0.18 () {60 vars in 1131 bytes} [Mon May 2 08:45:08 2022] POST /identity/v3/users => generated 160 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 02 08:45:08.924420 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0717808-9dc0-4b04-a318-ba87b783a2f9 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:09.016881 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0717808-9dc0-4b04-a318-ba87b783a2f9 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:09.049186 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14d2fb-4a12-4f68-a4ef-c4cd754f7127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:09.049980 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14d2fb-4a12-4f68-a4ef-c4cd754f7127 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:09.050263 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14d2fb-4a12-4f68-a4ef-c4cd754f7127 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:09.050535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14d2fb-4a12-4f68-a4ef-c4cd754f7127 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:09.057420 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14d2fb-4a12-4f68-a4ef-c4cd754f7127 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:09.058868 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14d2fb-4a12-4f68-a4ef-c4cd754f7127 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:09.073163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-eb14d2fb-4a12-4f68-a4ef-c4cd754f7127 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 02 08:45:09.073163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:09.073163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:45:09.073163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:45:09.073163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:45:09.073163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:45:09.073163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:45:09.073163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:45:09.073163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:45:09.073163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:45:09.073163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:45:09.073163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:45:09.073163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:45:09.073163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:45:09.073163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:45:09.073163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:45:09.074130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:45:09.074130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:45:09.074130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:45:09.074130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:45:09.074130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:45:09.074130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:45:09.074130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:45:09.074130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:45:09.074130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:45:09.074130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:45:09.074130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:45:09.074130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:45:09.074130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:45:09.074130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:45:09.074130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:45:09.074130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:45:09.074130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:45:09.074130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:45:09.075092 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:45:09.075092 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:45:09.075092 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:45:09.075092 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:45:09.075092 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:45:09.075092 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:45:09.075092 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:45:09.075092 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:45:09.075092 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 02 08:45:09.075092 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:45:09.076502 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 393/807] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:45:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:45:09.080820 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30efc3c-9ee0-448e-bd0c-d9af87b4b61a None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:09.177592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30efc3c-9ee0-448e-bd0c-d9af87b4b61a None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:09.210644 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a81a0c-363a-49c7-88d4-2e4343add915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:09.211303 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a81a0c-363a-49c7-88d4-2e4343add915 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:09.211585 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a81a0c-363a-49c7-88d4-2e4343add915 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:09.211860 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a81a0c-363a-49c7-88d4-2e4343add915 None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:09.212679 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a81a0c-363a-49c7-88d4-2e4343add915 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:45:09.212986 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a81a0c-363a-49c7-88d4-2e4343add915 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:09.214643 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a81a0c-363a-49c7-88d4-2e4343add915 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:09.251703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 415/808] 10.222.0.18 () {56 vars in 1101 bytes} [Mon May 2 08:45:09 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:45:10.383661 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ca5ed-a624-407f-a47b-e445070ca4e3 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:10.384217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ca5ed-a624-407f-a47b-e445070ca4e3 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:10.384347 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ca5ed-a624-407f-a47b-e445070ca4e3 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:10.385608 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 394/809] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:45:10.391092 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6d6f5-e17a-4a16-8ffa-bc19208c6ed2 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:10.391528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6d6f5-e17a-4a16-8ffa-bc19208c6ed2 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:10.391661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6d6f5-e17a-4a16-8ffa-bc19208c6ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:10.408719 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-5ae6d6f5-e17a-4a16-8ffa-bc19208c6ed2 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:45:10.410220 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-5ae6d6f5-e17a-4a16-8ffa-bc19208c6ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:45:10.475511 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 416/810] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:45:10 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:45:10.500425 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ca5ed-a624-407f-a47b-e445070ca4e3 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:10.595313 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ca5ed-a624-407f-a47b-e445070ca4e3 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:10.627100 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dd22a-c862-46f8-9956-90673c98a1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:10.627881 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dd22a-c862-46f8-9956-90673c98a1e8 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:10.628197 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dd22a-c862-46f8-9956-90673c98a1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:10.628473 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dd22a-c862-46f8-9956-90673c98a1e8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:10.629120 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88dd22a-c862-46f8-9956-90673c98a1e8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:10.630510 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88dd22a-c862-46f8-9956-90673c98a1e8 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:10.643110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-e88dd22a-c862-46f8-9956-90673c98a1e8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 02 08:45:10.643110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:10.643110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:45:10.643110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:45:10.643110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:45:10.643110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:45:10.643110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:45:10.643110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:45:10.643110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 02 08:45:10.643110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:45:10.643110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:45:10.643110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:45:10.643110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:10.643110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:45:10.643110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:45:10.643110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:45:10.643110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:45:10.644327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:45:10.644327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:45:10.644327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:45:10.644327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:45:10.644327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:45:10.644327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:45:10.644327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:45:10.644327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:45:10.644327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:45:10.644327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:45:10.644327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:45:10.644327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:45:10.644327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:45:10.644327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:45:10.644327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:45:10.644327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:45:10.645254 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:45:10.645254 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:45:10.645254 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:45:10.645254 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:45:10.645254 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:45:10.645254 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:45:10.645254 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:45:10.645254 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:45:10.645254 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:45:10.645254 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:45:10.645254 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:45:10.645254 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:45:10.645254 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 02 08:45:10.645254 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:45:10.645254 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 395/811] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:45:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:45:10.650189 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6d6f5-e17a-4a16-8ffa-bc19208c6ed2 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:10.743718 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6d6f5-e17a-4a16-8ffa-bc19208c6ed2 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:10.779311 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b01d4d-8ca2-4649-8997-017e09e7e29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:10.779963 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b01d4d-8ca2-4649-8997-017e09e7e29f None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:10.780273 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b01d4d-8ca2-4649-8997-017e09e7e29f None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:10.780544 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b01d4d-8ca2-4649-8997-017e09e7e29f None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:10.781234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b01d4d-8ca2-4649-8997-017e09e7e29f None admin] RBAC: Adding query filter params (name=compute) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:45:10.781538 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b01d4d-8ca2-4649-8997-017e09e7e29f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:10.782903 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b01d4d-8ca2-4649-8997-017e09e7e29f None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:10.787511 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 417/812] 10.222.0.18 () {56 vars in 1112 bytes} [Mon May 2 08:45:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:45:10.793153 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dd22a-c862-46f8-9956-90673c98a1e8 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:10.887130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dd22a-c862-46f8-9956-90673c98a1e8 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:10.918581 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170effe9-4ee8-4fdb-bf05-9907f5b1d983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:10.919794 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170effe9-4ee8-4fdb-bf05-9907f5b1d983 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:10.920098 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170effe9-4ee8-4fdb-bf05-9907f5b1d983 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:10.920378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170effe9-4ee8-4fdb-bf05-9907f5b1d983 None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:10.921076 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170effe9-4ee8-4fdb-bf05-9907f5b1d983 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:45:10.921385 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170effe9-4ee8-4fdb-bf05-9907f5b1d983 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:10.922763 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170effe9-4ee8-4fdb-bf05-9907f5b1d983 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:10.927337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 396/813] 10.222.0.18 () {56 vars in 1112 bytes} [Mon May 2 08:45:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:45:10.933183 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b01d4d-8ca2-4649-8997-017e09e7e29f None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:11.029763 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b01d4d-8ca2-4649-8997-017e09e7e29f None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:11.060901 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311fb95-4b87-4e2c-ba7b-8a428e97c5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:11.061537 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311fb95-4b87-4e2c-ba7b-8a428e97c5a9 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:11.061818 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311fb95-4b87-4e2c-ba7b-8a428e97c5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:11.062082 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311fb95-4b87-4e2c-ba7b-8a428e97c5a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:11.062850 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311fb95-4b87-4e2c-ba7b-8a428e97c5a9 None admin] RBAC: Adding query filter params (interface=public, service_id=c97502ab92c24d4e9cd355a500ce497e, region_id=RegionOne) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:45:11.063152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311fb95-4b87-4e2c-ba7b-8a428e97c5a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:11.064533 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311fb95-4b87-4e2c-ba7b-8a428e97c5a9 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:11.069223 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 418/814] 10.222.0.18 () {56 vars in 1251 bytes} [Mon May 2 08:45:10 2022] GET /identity/v3/endpoints?service_id=c97502ab92c24d4e9cd355a500ce497e&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:45:11.075043 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170effe9-4ee8-4fdb-bf05-9907f5b1d983 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:11.169410 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170effe9-4ee8-4fdb-bf05-9907f5b1d983 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:11.200000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea0088-ac1d-4a09-be8e-b9cbb752aa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:11.201432 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea0088-ac1d-4a09-be8e-b9cbb752aa45 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:11.201712 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea0088-ac1d-4a09-be8e-b9cbb752aa45 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:11.201982 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea0088-ac1d-4a09-be8e-b9cbb752aa45 None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:11.202645 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea0088-ac1d-4a09-be8e-b9cbb752aa45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:11.204007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea0088-ac1d-4a09-be8e-b9cbb752aa45 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:11.209874 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 397/815] 10.222.0.18 () {56 vars in 1087 bytes} [Mon May 2 08:45:11 2022] GET /identity/v3/services => generated 1728 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 08:45:13.486447 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538d411-a465-4d22-9e82-6ddf626dc5ee None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:13.486981 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538d411-a465-4d22-9e82-6ddf626dc5ee None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:13.486981 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538d411-a465-4d22-9e82-6ddf626dc5ee None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:13.488396 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 419/816] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:45:13.493660 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc8da2-dd30-4f67-a1ed-504d64a78255 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:13.494105 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc8da2-dd30-4f67-a1ed-504d64a78255 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:13.494229 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc8da2-dd30-4f67-a1ed-504d64a78255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:13.511185 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-1ddc8da2-dd30-4f67-a1ed-504d64a78255 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:45:13.512397 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-1ddc8da2-dd30-4f67-a1ed-504d64a78255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:45:13.574912 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 398/817] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:45:13 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:45:13.597950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538d411-a465-4d22-9e82-6ddf626dc5ee None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:13.692659 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538d411-a465-4d22-9e82-6ddf626dc5ee None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:13.723991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edeb935-5da7-4b06-abc2-dd4f82ad2b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:13.724789 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edeb935-5da7-4b06-abc2-dd4f82ad2b4b None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:13.725069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edeb935-5da7-4b06-abc2-dd4f82ad2b4b None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:13.725339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edeb935-5da7-4b06-abc2-dd4f82ad2b4b None admin] PATH_INFO: `/v3/services/compute` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:13.725975 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edeb935-5da7-4b06-abc2-dd4f82ad2b4b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:13.727326 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edeb935-5da7-4b06-abc2-dd4f82ad2b4b None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:13.739247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-7edeb935-5da7-4b06-abc2-dd4f82ad2b4b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 02 08:45:13.739247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:13.739247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:45:13.739247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:45:13.739247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:45:13.739247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:45:13.739247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:45:13.739247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:45:13.739247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 02 08:45:13.739247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:45:13.739247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:45:13.739247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:45:13.739247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:45:13.739247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:45:13.739247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:45:13.739247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:45:13.739247 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:45:13.740441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:45:13.740441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:45:13.740441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:45:13.740441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:45:13.740441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:45:13.740441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:45:13.740441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:45:13.740441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:45:13.740441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:45:13.740441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:45:13.740441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:45:13.740441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:45:13.740441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:45:13.740441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:45:13.740441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:45:13.740441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:45:13.741723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:45:13.741723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:45:13.741723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:45:13.741723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:45:13.741723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:45:13.741723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:45:13.741723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:45:13.741723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:45:13.741723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:45:13.741723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:45:13.741723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:45:13.741723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:45:13.741723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 02 08:45:13.741723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:45:13.741723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 420/818] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:45:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:45:13.746330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc8da2-dd30-4f67-a1ed-504d64a78255 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:13.838005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc8da2-dd30-4f67-a1ed-504d64a78255 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:13.870035 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a396a-dd07-4f61-8643-deba143afc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:13.870685 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a396a-dd07-4f61-8643-deba143afc7a None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:13.870970 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a396a-dd07-4f61-8643-deba143afc7a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:13.871247 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a396a-dd07-4f61-8643-deba143afc7a None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:13.871942 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a396a-dd07-4f61-8643-deba143afc7a None admin] RBAC: Adding query filter params (name=compute) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:45:13.872320 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a396a-dd07-4f61-8643-deba143afc7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:13.873692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a396a-dd07-4f61-8643-deba143afc7a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:13.878193 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 399/819] 10.222.0.18 () {56 vars in 1112 bytes} [Mon May 2 08:45:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:45:13.883707 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edeb935-5da7-4b06-abc2-dd4f82ad2b4b None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:13.979541 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edeb935-5da7-4b06-abc2-dd4f82ad2b4b None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:14.011871 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b502cc-b962-464a-b3ba-681d2a26c041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:14.012500 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b502cc-b962-464a-b3ba-681d2a26c041 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:14.013405 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b502cc-b962-464a-b3ba-681d2a26c041 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:14.013689 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b502cc-b962-464a-b3ba-681d2a26c041 None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:14.014392 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b502cc-b962-464a-b3ba-681d2a26c041 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:45:14.014701 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b502cc-b962-464a-b3ba-681d2a26c041 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:14.016087 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b502cc-b962-464a-b3ba-681d2a26c041 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:14.020785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 421/820] 10.222.0.18 () {56 vars in 1112 bytes} [Mon May 2 08:45:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:45:14.026449 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a396a-dd07-4f61-8643-deba143afc7a None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:45:14.119557 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a396a-dd07-4f61-8643-deba143afc7a None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:45:14.151096 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4a208-4bd3-4ea2-9b13-d658e5c6524e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:45:14.151743 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4a208-4bd3-4ea2-9b13-d658e5c6524e None admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:45:14.152024 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4a208-4bd3-4ea2-9b13-d658e5c6524e None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:45:14.152327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4a208-4bd3-4ea2-9b13-d658e5c6524e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:45:14.153049 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4a208-4bd3-4ea2-9b13-d658e5c6524e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:45:14.154500 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4a208-4bd3-4ea2-9b13-d658e5c6524e None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:45:14.223894 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 400/821] 10.222.0.18 () {60 vars in 1144 bytes} [Mon May 2 08:45:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:46:32.653863 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f8395-04f6-4729-ad65-66fea6d87c37 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:32.654450 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f8395-04f6-4729-ad65-66fea6d87c37 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:32.654450 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f8395-04f6-4729-ad65-66fea6d87c37 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:32.655768 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 422/822] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:46:32.661130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e780bf-95df-497b-938f-6d1954b8d3ef None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:32.661529 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e780bf-95df-497b-938f-6d1954b8d3ef None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:32.661686 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e780bf-95df-497b-938f-6d1954b8d3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:32.678659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-04e780bf-95df-497b-938f-6d1954b8d3ef None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:46:32.679883 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-04e780bf-95df-497b-938f-6d1954b8d3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:46:32.748656 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 401/823] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:46:32 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:46:32.775931 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f8395-04f6-4729-ad65-66fea6d87c37 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:32.872622 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f8395-04f6-4729-ad65-66fea6d87c37 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:32.905446 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3b683-2375-4f14-bee3-3786d2c9e3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:32.906164 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3b683-2375-4f14-bee3-3786d2c9e3df None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:32.906444 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3b683-2375-4f14-bee3-3786d2c9e3df None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:32.906761 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3b683-2375-4f14-bee3-3786d2c9e3df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:32.916319 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3b683-2375-4f14-bee3-3786d2c9e3df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:32.917766 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3b683-2375-4f14-bee3-3786d2c9e3df None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:32.935085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-08f3b683-2375-4f14-bee3-3786d2c9e3df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:32.935085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:32.935085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:32.935085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:32.935085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:32.935085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:32.935085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:32.935085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:32.935085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:32.935085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:32.935085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:32.935085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:32.935085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:46:32.935085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:46:32.935085 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:46:32.936286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:46:32.936286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:32.936286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:32.936286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:32.936286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:32.936286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:32.936286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:32.936286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:32.936286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:46:32.936286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:32.936286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:32.936286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:32.936286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:32.936286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:32.936286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:32.936286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:32.936286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:32.937293 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:46:32.937293 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:46:32.937293 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:32.937293 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:46:32.937293 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 423/824] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:32.942971 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e780bf-95df-497b-938f-6d1954b8d3ef None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:33.038171 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e780bf-95df-497b-938f-6d1954b8d3ef None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:33.070397 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a2d80-d140-4c1a-aa53-87efa88893e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:33.071304 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a2d80-d140-4c1a-aa53-87efa88893e3 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:33.071581 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a2d80-d140-4c1a-aa53-87efa88893e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:33.071867 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a2d80-d140-4c1a-aa53-87efa88893e3 None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:33.072608 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a2d80-d140-4c1a-aa53-87efa88893e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:33.072911 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a2d80-d140-4c1a-aa53-87efa88893e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:33.074276 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a2d80-d140-4c1a-aa53-87efa88893e3 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:33.085692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 402/825] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:33.091399 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3b683-2375-4f14-bee3-3786d2c9e3df None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:33.187477 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3b683-2375-4f14-bee3-3786d2c9e3df None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:33.220942 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f2bb2-d48b-47e8-8d49-ccc1494083c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:33.221590 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f2bb2-d48b-47e8-8d49-ccc1494083c8 None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:33.221870 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f2bb2-d48b-47e8-8d49-ccc1494083c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:33.222139 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f2bb2-d48b-47e8-8d49-ccc1494083c8 None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:33.222937 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f2bb2-d48b-47e8-8d49-ccc1494083c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:33.224406 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f2bb2-d48b-47e8-8d49-ccc1494083c8 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:33.308990 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 424/826] 10.222.0.18 () {60 vars in 1132 bytes} [Mon May 2 08:46:33 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:46:35.678895 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55736f-3662-4086-8965-f98d307d805c None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:35.679441 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55736f-3662-4086-8965-f98d307d805c None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:35.679540 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55736f-3662-4086-8965-f98d307d805c None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:35.680897 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 403/827] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:46:35.686097 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d0504-913a-45f5-a6ec-f62e09d2495f None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:35.688522 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d0504-913a-45f5-a6ec-f62e09d2495f None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:35.688522 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d0504-913a-45f5-a6ec-f62e09d2495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:35.703980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-0e1d0504-913a-45f5-a6ec-f62e09d2495f None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:46:35.705622 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-0e1d0504-913a-45f5-a6ec-f62e09d2495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:46:35.770146 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 425/828] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:46:35 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:46:35.794525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55736f-3662-4086-8965-f98d307d805c None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:35.894394 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55736f-3662-4086-8965-f98d307d805c None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:35.927465 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a452e-8646-448d-9f6d-f0899ae4475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:35.928228 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a452e-8646-448d-9f6d-f0899ae4475f None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:35.928516 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a452e-8646-448d-9f6d-f0899ae4475f None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:35.928790 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a452e-8646-448d-9f6d-f0899ae4475f None admin] PATH_INFO: `/v3/roles/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:35.938461 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a452e-8646-448d-9f6d-f0899ae4475f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:46:35.947461 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-040a452e-8646-448d-9f6d-f0899ae4475f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 08:46:35.947461 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:35.947461 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:35.947461 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:35.947461 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:35.947461 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:35.947461 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:35.947461 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:35.947461 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:35.947461 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:35.947461 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:35.947461 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:35.947461 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:46:35.947461 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:46:35.947461 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:46:35.947461 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:46:35.953265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:46:35.953265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:46:35.953265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:46:35.953265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:46:35.953265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:35.953265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:35.953265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:35.953265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:35.953265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:35.953265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:35.953265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:35.953265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:46:35.953265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:35.953265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:35.953265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:35.953265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:35.955436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:35.955436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:35.955436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:35.955436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:35.955436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:46:35.955436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:46:35.955436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:46:35.955436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:46:35.955436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:46:35.955436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:46:35.955436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 08:46:35.955436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:46:35.955436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 404/829] 10.222.0.18 () {56 vars in 1102 bytes} [Mon May 2 08:46:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:35.956882 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d0504-913a-45f5-a6ec-f62e09d2495f None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:36.054368 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d0504-913a-45f5-a6ec-f62e09d2495f None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:36.086837 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a68bd-25b1-436b-b5bd-6665f0d42542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:36.087496 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a68bd-25b1-436b-b5bd-6665f0d42542 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:36.087804 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a68bd-25b1-436b-b5bd-6665f0d42542 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:36.088106 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a68bd-25b1-436b-b5bd-6665f0d42542 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:36.088845 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a68bd-25b1-436b-b5bd-6665f0d42542 None admin] RBAC: Adding query filter params (name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:36.089156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a68bd-25b1-436b-b5bd-6665f0d42542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:36.090522 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a68bd-25b1-436b-b5bd-6665f0d42542 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:36.098865 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 426/830] 10.222.0.18 () {56 vars in 1103 bytes} [Mon May 2 08:46:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:46:36.104895 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a452e-8646-448d-9f6d-f0899ae4475f None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:36.203095 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a452e-8646-448d-9f6d-f0899ae4475f None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:36.234905 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31958a0-b459-4a10-9e3e-77edf4db5464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:36.235683 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31958a0-b459-4a10-9e3e-77edf4db5464 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:36.236579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31958a0-b459-4a10-9e3e-77edf4db5464 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:36.236862 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31958a0-b459-4a10-9e3e-77edf4db5464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:36.246851 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31958a0-b459-4a10-9e3e-77edf4db5464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:36.248325 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31958a0-b459-4a10-9e3e-77edf4db5464 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:36.264505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-e31958a0-b459-4a10-9e3e-77edf4db5464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:36.264505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:36.264505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:36.264505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:36.264505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:36.264505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:36.264505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:36.264505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:36.264505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:36.264505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:36.264505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:36.264505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:36.264505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:46:36.264505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:46:36.264505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:46:36.265383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:46:36.265383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:36.265383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:36.265383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:36.265383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:36.265383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:36.265383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:36.265383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:36.265383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:46:36.265383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:36.265383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:36.265383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:36.265383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:36.265383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:36.265383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:36.265383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:36.265383 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:36.266282 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:46:36.266282 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:46:36.266282 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:36.266282 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:46:36.266282 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 405/831] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:36.271679 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a68bd-25b1-436b-b5bd-6665f0d42542 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:36.370216 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a68bd-25b1-436b-b5bd-6665f0d42542 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:36.403696 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06d5ad-97d7-4a6f-bde0-7eff1877149b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:36.404377 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06d5ad-97d7-4a6f-bde0-7eff1877149b None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:36.404661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06d5ad-97d7-4a6f-bde0-7eff1877149b None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:36.404975 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06d5ad-97d7-4a6f-bde0-7eff1877149b None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:36.405692 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06d5ad-97d7-4a6f-bde0-7eff1877149b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:36.405999 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06d5ad-97d7-4a6f-bde0-7eff1877149b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:36.407362 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06d5ad-97d7-4a6f-bde0-7eff1877149b None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:36.419631 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 427/832] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:36.425470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31958a0-b459-4a10-9e3e-77edf4db5464 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:36.520648 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31958a0-b459-4a10-9e3e-77edf4db5464 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:36.551809 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e93707-173b-498f-aa81-e80b58b0867d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:36.552638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e93707-173b-498f-aa81-e80b58b0867d None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:36.552919 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e93707-173b-498f-aa81-e80b58b0867d None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:36.553191 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e93707-173b-498f-aa81-e80b58b0867d None admin] PATH_INFO: `/v3/users/placement` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:36.560178 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e93707-173b-498f-aa81-e80b58b0867d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:36.561610 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e93707-173b-498f-aa81-e80b58b0867d None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:36.575521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-c6e93707-173b-498f-aa81-e80b58b0867d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 02 08:46:36.575521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:36.575521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:36.575521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:36.575521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:36.575521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:36.575521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:36.575521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:36.575521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:36.575521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:36.575521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:36.575521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:36.575521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:46:36.575521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:46:36.575521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:46:36.575521 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:46:36.576707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:36.576707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:36.576707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:46:36.576707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:46:36.576707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:46:36.576707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:46:36.576707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:36.576707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:36.576707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:36.576707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:36.576707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:36.576707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:46:36.576707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:36.576707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:36.576707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:36.576707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:36.576707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:36.576707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:36.577866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:36.577866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:36.577866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:46:36.577866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:46:36.577866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:46:36.577866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:46:36.577866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:46:36.577866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:46:36.577866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 02 08:46:36.577866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:46:36.577866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 406/833] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:36.583163 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06d5ad-97d7-4a6f-bde0-7eff1877149b None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:36.680077 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06d5ad-97d7-4a6f-bde0-7eff1877149b None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:36.713641 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a6333-5732-4f6c-9878-740478f26151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:36.714495 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a6333-5732-4f6c-9878-740478f26151 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:36.714782 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a6333-5732-4f6c-9878-740478f26151 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:36.715058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a6333-5732-4f6c-9878-740478f26151 None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:36.715875 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a6333-5732-4f6c-9878-740478f26151 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:36.716218 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a6333-5732-4f6c-9878-740478f26151 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:36.717642 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a6333-5732-4f6c-9878-740478f26151 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:36.734898 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 428/834] 10.222.0.18 () {56 vars in 1143 bytes} [Mon May 2 08:46:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:36.741357 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e93707-173b-498f-aa81-e80b58b0867d None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:36.838341 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e93707-173b-498f-aa81-e80b58b0867d None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:36.871975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff7b11-1af7-4549-b818-0b81fcef9f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:36.872696 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff7b11-1af7-4549-b818-0b81fcef9f04 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:36.872976 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff7b11-1af7-4549-b818-0b81fcef9f04 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:36.873252 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff7b11-1af7-4549-b818-0b81fcef9f04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:36.936888 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff7b11-1af7-4549-b818-0b81fcef9f04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:36.938335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff7b11-1af7-4549-b818-0b81fcef9f04 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:37.031238 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 407/835] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:46:36 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 08:46:37.037661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a6333-5732-4f6c-9878-740478f26151 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:37.131662 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a6333-5732-4f6c-9878-740478f26151 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:37.166469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2eb81-07b8-4677-85d0-ec062e123e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:37.167253 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2eb81-07b8-4677-85d0-ec062e123e5a None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:37.167536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2eb81-07b8-4677-85d0-ec062e123e5a None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:37.167810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2eb81-07b8-4677-85d0-ec062e123e5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:37.178050 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2eb81-07b8-4677-85d0-ec062e123e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:37.179484 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2eb81-07b8-4677-85d0-ec062e123e5a None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:37.196601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-39d2eb81-07b8-4677-85d0-ec062e123e5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:37.196601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:37.196601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:37.196601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:37.196601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:37.196601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:37.196601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:37.196601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:37.196601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:37.196601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:37.196601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:37.196601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:37.196601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:46:37.196601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:46:37.196601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:46:37.198668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:46:37.198668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:37.198668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:37.198668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:37.198668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:37.198668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:37.198668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:37.198668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:37.198668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:46:37.198668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:37.198668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:37.198668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:37.198668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:37.198668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:37.198668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:37.198668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:37.198668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:37.199656 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:46:37.199656 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:46:37.199656 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:37.199656 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:46:37.199656 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 429/836] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:37.203518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff7b11-1af7-4549-b818-0b81fcef9f04 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:37.301021 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff7b11-1af7-4549-b818-0b81fcef9f04 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:37.334128 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aec94-fa49-4593-80c1-d7b9752edfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:37.334771 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aec94-fa49-4593-80c1-d7b9752edfde None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:37.335052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aec94-fa49-4593-80c1-d7b9752edfde None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:37.335352 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aec94-fa49-4593-80c1-d7b9752edfde None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:37.336092 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284aec94-fa49-4593-80c1-d7b9752edfde None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:37.336406 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284aec94-fa49-4593-80c1-d7b9752edfde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:37.337803 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284aec94-fa49-4593-80c1-d7b9752edfde None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:37.349481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 408/837] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:37.355055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2eb81-07b8-4677-85d0-ec062e123e5a None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:37.450934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2eb81-07b8-4677-85d0-ec062e123e5a None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:37.484526 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b9fd2-ae8c-4bd8-bef6-bfb4023c65e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:37.485312 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b9fd2-ae8c-4bd8-bef6-bfb4023c65e3 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:37.485594 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b9fd2-ae8c-4bd8-bef6-bfb4023c65e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:37.485866 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b9fd2-ae8c-4bd8-bef6-bfb4023c65e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:37.492698 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b9fd2-ae8c-4bd8-bef6-bfb4023c65e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:37.494140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b9fd2-ae8c-4bd8-bef6-bfb4023c65e3 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:37.508069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-d60b9fd2-ae8c-4bd8-bef6-bfb4023c65e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:46:37.508069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:37.508069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:37.508069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:37.508069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:37.508069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:37.508069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:37.508069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:37.508069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:37.508069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:37.508069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:37.508069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:37.508069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:46:37.508069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:46:37.508069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:46:37.509016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:46:37.509016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:37.509016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:37.509016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:37.509016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:37.509016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:37.509016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:37.509016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:37.509016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:46:37.509016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:37.509016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:37.509016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:37.509016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:37.509016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:37.509016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:37.509016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:37.509016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:37.509945 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:46:37.509945 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:46:37.509945 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:46:37.509945 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:46:37.509945 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:46:37.509945 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:46:37.509945 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:46:37.509945 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:46:37.509945 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 430/838] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:46:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:37.515193 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aec94-fa49-4593-80c1-d7b9752edfde None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:37.613947 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aec94-fa49-4593-80c1-d7b9752edfde None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:37.646833 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f7a1a-112f-4465-94e9-45eda4a377dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:37.647490 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f7a1a-112f-4465-94e9-45eda4a377dc None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:37.647769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f7a1a-112f-4465-94e9-45eda4a377dc None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:37.648037 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f7a1a-112f-4465-94e9-45eda4a377dc None admin] PATH_INFO: `/v3/projects` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:37.648837 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f7a1a-112f-4465-94e9-45eda4a377dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:37.649144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f7a1a-112f-4465-94e9-45eda4a377dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:37.650599 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f7a1a-112f-4465-94e9-45eda4a377dc None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:37.665731 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 409/839] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:46:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:37.668442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b9fd2-ae8c-4bd8-bef6-bfb4023c65e3 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:37.763606 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b9fd2-ae8c-4bd8-bef6-bfb4023c65e3 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:37.795704 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0486e-e555-44a2-8ef8-4236b84e3a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:37.796369 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0486e-e555-44a2-8ef8-4236b84e3a70 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:37.796650 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0486e-e555-44a2-8ef8-4236b84e3a70 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:37.796920 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0486e-e555-44a2-8ef8-4236b84e3a70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:37.797755 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0486e-e555-44a2-8ef8-4236b84e3a70 None admin] RBAC: Adding query filter params (role.id=78258bf52d1f4340bb3f7eda6a73f71a, scope.project.id=758931ec3ed54a1eadf1b9a463fbb241, user.id=894ff70da3bb45ce858b2d34224eab93) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:37.798062 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0486e-e555-44a2-8ef8-4236b84e3a70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:37.799677 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0486e-e555-44a2-8ef8-4236b84e3a70 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:37.804934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 431/840] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:46:37 2022] GET /identity/v3/role_assignments?user.id=894ff70da3bb45ce858b2d34224eab93&scope.project.id=758931ec3ed54a1eadf1b9a463fbb241&role.id=78258bf52d1f4340bb3f7eda6a73f71a => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:40.063276 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37253249-474e-4bb6-95bb-45cf6af84cdd None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:40.063790 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37253249-474e-4bb6-95bb-45cf6af84cdd None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:40.063790 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37253249-474e-4bb6-95bb-45cf6af84cdd None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:40.065211 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 410/841] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:46:40.070499 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950adb1f-f0f6-42a3-88dd-e4aa849d3e5c None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:40.071150 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950adb1f-f0f6-42a3-88dd-e4aa849d3e5c None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:40.071307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950adb1f-f0f6-42a3-88dd-e4aa849d3e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:40.087577 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-950adb1f-f0f6-42a3-88dd-e4aa849d3e5c None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:46:40.088767 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-950adb1f-f0f6-42a3-88dd-e4aa849d3e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:46:40.153306 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 432/842] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:46:40 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:46:40.178093 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37253249-474e-4bb6-95bb-45cf6af84cdd None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:40.275577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37253249-474e-4bb6-95bb-45cf6af84cdd None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:40.308723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f12de7-8a91-49bf-b028-9c92fd2b7b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:40.309508 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f12de7-8a91-49bf-b028-9c92fd2b7b9c None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:40.309790 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f12de7-8a91-49bf-b028-9c92fd2b7b9c None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:40.310059 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f12de7-8a91-49bf-b028-9c92fd2b7b9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:40.319678 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f12de7-8a91-49bf-b028-9c92fd2b7b9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:46:40.327504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-53f12de7-8a91-49bf-b028-9c92fd2b7b9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 08:46:40.327504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:40.327504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:40.327504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:40.327504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:40.327504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:40.327504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:40.327504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:40.327504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:40.327504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:40.327504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:40.327504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:40.327504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:46:40.327504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:46:40.327504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:46:40.327504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:46:40.330614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:46:40.330614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:46:40.330614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:46:40.330614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:46:40.330614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:40.330614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:40.330614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:40.330614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:40.330614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:40.330614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:40.330614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:40.330614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:46:40.330614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:40.330614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:40.330614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:40.330614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:40.331478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:40.331478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:40.331478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:40.331478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:40.331478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:46:40.331478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:46:40.331478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:46:40.331478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:46:40.331478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:46:40.331478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:46:40.331478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 08:46:40.331478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:46:40.331478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 411/843] 10.222.0.18 () {56 vars in 1102 bytes} [Mon May 2 08:46:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:40.335386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950adb1f-f0f6-42a3-88dd-e4aa849d3e5c None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:40.436752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950adb1f-f0f6-42a3-88dd-e4aa849d3e5c None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:40.469705 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4904823-ae04-444e-88e4-6127b8eb85c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:40.471009 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4904823-ae04-444e-88e4-6127b8eb85c7 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:40.471301 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4904823-ae04-444e-88e4-6127b8eb85c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:40.471604 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4904823-ae04-444e-88e4-6127b8eb85c7 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:40.472371 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4904823-ae04-444e-88e4-6127b8eb85c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:40.472680 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4904823-ae04-444e-88e4-6127b8eb85c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:40.474053 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4904823-ae04-444e-88e4-6127b8eb85c7 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:40.481870 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 433/844] 10.222.0.18 () {56 vars in 1103 bytes} [Mon May 2 08:46:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:40.487825 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f12de7-8a91-49bf-b028-9c92fd2b7b9c None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:40.584486 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f12de7-8a91-49bf-b028-9c92fd2b7b9c None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:40.615685 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b3c70-d67f-467d-9875-edcc35316c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:40.616509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b3c70-d67f-467d-9875-edcc35316c72 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:40.616796 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b3c70-d67f-467d-9875-edcc35316c72 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:40.617067 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b3c70-d67f-467d-9875-edcc35316c72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:40.627715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b3c70-d67f-467d-9875-edcc35316c72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:40.629223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b3c70-d67f-467d-9875-edcc35316c72 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:40.646587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-355b3c70-d67f-467d-9875-edcc35316c72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:40.646587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:40.646587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:40.646587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:40.646587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:40.646587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:40.646587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:40.646587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:40.646587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:40.646587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:40.646587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:40.646587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:40.646587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:46:40.646587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:46:40.646587 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:46:40.647821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:46:40.647821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:40.647821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:40.647821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:40.647821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:40.647821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:40.647821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:40.647821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:40.647821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:46:40.647821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:40.647821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:40.647821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:40.647821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:40.647821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:40.647821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:40.647821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:40.647821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:40.649016 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:46:40.649016 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:46:40.649016 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:40.649016 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:46:40.649016 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 412/845] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:40.653638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4904823-ae04-444e-88e4-6127b8eb85c7 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:40.747342 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4904823-ae04-444e-88e4-6127b8eb85c7 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:40.779786 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54a634-6589-4a31-af5c-e229acb3a140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:40.780465 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54a634-6589-4a31-af5c-e229acb3a140 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:40.780748 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54a634-6589-4a31-af5c-e229acb3a140 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:40.781084 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54a634-6589-4a31-af5c-e229acb3a140 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:40.781815 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54a634-6589-4a31-af5c-e229acb3a140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:40.782115 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54a634-6589-4a31-af5c-e229acb3a140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:40.783564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54a634-6589-4a31-af5c-e229acb3a140 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:40.795351 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 434/846] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:40.801336 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b3c70-d67f-467d-9875-edcc35316c72 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:40.897633 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b3c70-d67f-467d-9875-edcc35316c72 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:40.930426 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4636a-5107-43cc-ad7b-8e574262008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:40.931226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4636a-5107-43cc-ad7b-8e574262008c None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:40.931506 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4636a-5107-43cc-ad7b-8e574262008c None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:40.931780 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4636a-5107-43cc-ad7b-8e574262008c None admin] PATH_INFO: `/v3/users/placement` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:40.939540 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4636a-5107-43cc-ad7b-8e574262008c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:40.941069 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4636a-5107-43cc-ad7b-8e574262008c None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:40.955653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-cce4636a-5107-43cc-ad7b-8e574262008c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 02 08:46:40.955653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:40.955653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:40.955653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:40.955653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:40.955653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:40.955653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:40.955653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:40.955653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:40.955653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:40.955653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:40.955653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:40.955653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:46:40.955653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:46:40.955653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:46:40.955653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:46:40.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:40.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:40.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:46:40.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:46:40.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:46:40.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:46:40.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:40.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:40.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:40.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:40.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:40.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:46:40.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:40.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:40.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:40.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:40.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:40.956811 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:40.957784 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:40.957784 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:40.957784 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:46:40.957784 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:46:40.957784 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:46:40.957784 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:46:40.957784 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:46:40.957784 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:46:40.957784 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 02 08:46:40.957784 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:46:40.957784 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 413/847] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:40.962803 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54a634-6589-4a31-af5c-e229acb3a140 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:41.059802 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54a634-6589-4a31-af5c-e229acb3a140 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:41.092653 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d98c62-6d1b-4f3a-b2ac-cfd26c719767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:41.093308 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d98c62-6d1b-4f3a-b2ac-cfd26c719767 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:41.093586 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d98c62-6d1b-4f3a-b2ac-cfd26c719767 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:41.093857 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d98c62-6d1b-4f3a-b2ac-cfd26c719767 None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:41.094666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d98c62-6d1b-4f3a-b2ac-cfd26c719767 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:41.094966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d98c62-6d1b-4f3a-b2ac-cfd26c719767 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:41.096579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d98c62-6d1b-4f3a-b2ac-cfd26c719767 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:41.113374 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 435/848] 10.222.0.18 () {56 vars in 1143 bytes} [Mon May 2 08:46:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:41.119034 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4636a-5107-43cc-ad7b-8e574262008c None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:41.213963 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4636a-5107-43cc-ad7b-8e574262008c None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:41.245952 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a2fef-6247-4af5-8885-6642d3c531b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:41.246748 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a2fef-6247-4af5-8885-6642d3c531b2 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:41.247030 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a2fef-6247-4af5-8885-6642d3c531b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:41.247303 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a2fef-6247-4af5-8885-6642d3c531b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:41.257949 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a2fef-6247-4af5-8885-6642d3c531b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:41.259393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a2fef-6247-4af5-8885-6642d3c531b2 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:41.275997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-ad7a2fef-6247-4af5-8885-6642d3c531b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:41.275997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:41.275997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:41.275997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:41.275997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:41.275997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:41.275997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:41.275997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:41.275997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:41.275997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:41.275997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:41.275997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:41.275997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:46:41.275997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:46:41.275997 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:46:41.278475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:46:41.278475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:41.278475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:41.278475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:41.278475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:41.278475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:41.278475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:41.278475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:41.278475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:46:41.278475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:41.278475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:41.278475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:41.278475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:41.278475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:41.278475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:41.278475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:41.278475 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:41.279400 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:46:41.279400 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:46:41.279400 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:41.279400 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:46:41.279400 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 414/849] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:41.284031 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d98c62-6d1b-4f3a-b2ac-cfd26c719767 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:41.383108 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d98c62-6d1b-4f3a-b2ac-cfd26c719767 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:41.416925 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b0edd-8c2a-4734-800b-75c472535f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:41.417649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b0edd-8c2a-4734-800b-75c472535f44 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:41.417936 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b0edd-8c2a-4734-800b-75c472535f44 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:41.418213 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b0edd-8c2a-4734-800b-75c472535f44 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:41.418930 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b0edd-8c2a-4734-800b-75c472535f44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:41.419241 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b0edd-8c2a-4734-800b-75c472535f44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:41.420653 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b0edd-8c2a-4734-800b-75c472535f44 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:41.432790 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 436/850] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:41.438436 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a2fef-6247-4af5-8885-6642d3c531b2 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:41.533724 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a2fef-6247-4af5-8885-6642d3c531b2 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:41.566528 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c2b9f-b45e-4a02-b425-2262a87cbf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:41.567319 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c2b9f-b45e-4a02-b425-2262a87cbf0a None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:41.567601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c2b9f-b45e-4a02-b425-2262a87cbf0a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:41.567872 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c2b9f-b45e-4a02-b425-2262a87cbf0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:41.574501 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c2b9f-b45e-4a02-b425-2262a87cbf0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:41.575952 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c2b9f-b45e-4a02-b425-2262a87cbf0a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:41.589954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-512c2b9f-b45e-4a02-b425-2262a87cbf0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:46:41.589954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:41.589954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:41.589954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:41.589954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:41.589954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:41.589954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:41.589954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:41.589954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:41.589954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:41.589954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:41.589954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:41.589954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:46:41.589954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:46:41.589954 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:46:41.591029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:46:41.591029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:41.591029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:41.591029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:41.591029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:41.591029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:41.591029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:41.591029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:41.591029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:46:41.591029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:41.591029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:41.591029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:41.591029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:41.591029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:41.591029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:41.591029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:41.591029 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:41.592163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:46:41.592163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:46:41.592163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:46:41.592163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:46:41.592163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:46:41.592163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:46:41.592163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:46:41.592163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:46:41.592163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 415/851] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:46:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:46:41.597540 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b0edd-8c2a-4734-800b-75c472535f44 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:41.695367 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b0edd-8c2a-4734-800b-75c472535f44 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:41.728476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347ac5a-3e94-4315-a558-b7b63c676650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:41.729127 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347ac5a-3e94-4315-a558-b7b63c676650 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:41.729408 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347ac5a-3e94-4315-a558-b7b63c676650 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:41.729731 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347ac5a-3e94-4315-a558-b7b63c676650 None admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:41.730504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347ac5a-3e94-4315-a558-b7b63c676650 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:41.730809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347ac5a-3e94-4315-a558-b7b63c676650 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:41.732255 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347ac5a-3e94-4315-a558-b7b63c676650 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:41.743766 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 437/852] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:41.749910 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c2b9f-b45e-4a02-b425-2262a87cbf0a None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:41.846530 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c2b9f-b45e-4a02-b425-2262a87cbf0a None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:41.878063 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af889e-586d-47b3-8529-d2ae8bc58e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:41.878935 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af889e-586d-47b3-8529-d2ae8bc58e8c None admin] REQUEST_METHOD: `PUT` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:41.879276 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af889e-586d-47b3-8529-d2ae8bc58e8c None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:41.879527 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af889e-586d-47b3-8529-d2ae8bc58e8c None admin] PATH_INFO: `/v3/projects/758931ec3ed54a1eadf1b9a463fbb241/users/894ff70da3bb45ce858b2d34224eab93/roles/78258bf52d1f4340bb3f7eda6a73f71a` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:41.893430 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af889e-586d-47b3-8529-d2ae8bc58e8c None admin] RBAC: Authorizing `identity:create_grant(project_id=758931ec3ed54a1eadf1b9a463fbb241, user_id=894ff70da3bb45ce858b2d34224eab93, role_id=78258bf52d1f4340bb3f7eda6a73f71a)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:41.894859 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af889e-586d-47b3-8529-d2ae8bc58e8c None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:41.989525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 416/853] 10.222.0.18 () {58 vars in 1439 bytes} [Mon May 2 08:46:41 2022] PUT /identity/v3/projects/758931ec3ed54a1eadf1b9a463fbb241/users/894ff70da3bb45ce858b2d34224eab93/roles/78258bf52d1f4340bb3f7eda6a73f71a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:46:44.242151 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dd723-a9b2-4bb2-b5b5-0c4451ece7e8 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:44.242725 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dd723-a9b2-4bb2-b5b5-0c4451ece7e8 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:44.242725 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dd723-a9b2-4bb2-b5b5-0c4451ece7e8 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:44.244124 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 438/854] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:46:44.249300 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba174d0c-ed81-4ef2-99cb-c72a237b79e3 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:44.249708 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba174d0c-ed81-4ef2-99cb-c72a237b79e3 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:44.249842 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba174d0c-ed81-4ef2-99cb-c72a237b79e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:44.266831 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-ba174d0c-ed81-4ef2-99cb-c72a237b79e3 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:46:44.268295 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-ba174d0c-ed81-4ef2-99cb-c72a237b79e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:46:44.332662 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 417/855] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:46:44 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:46:44.357209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dd723-a9b2-4bb2-b5b5-0c4451ece7e8 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:44.456365 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dd723-a9b2-4bb2-b5b5-0c4451ece7e8 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:44.489716 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4a538-ab32-466b-8fb1-379f122adeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:44.490508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a538-ab32-466b-8fb1-379f122adeee None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:44.490875 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a538-ab32-466b-8fb1-379f122adeee None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:44.491109 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a538-ab32-466b-8fb1-379f122adeee None admin] PATH_INFO: `/v3/roles/service` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:44.501091 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4a538-ab32-466b-8fb1-379f122adeee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:46:44.509605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-16c4a538-ab32-466b-8fb1-379f122adeee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 08:46:44.509605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:44.509605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:44.509605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:44.509605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:44.509605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:44.509605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:44.509605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:44.509605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:44.509605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:44.509605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:44.509605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:44.509605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:46:44.509605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:46:44.509605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:46:44.509605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:46:44.510738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:46:44.510738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:46:44.510738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:46:44.510738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:46:44.510738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:44.510738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:44.510738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:44.510738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:44.510738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:44.510738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:44.510738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:44.510738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:46:44.510738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:44.510738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:44.510738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:44.510738 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:44.511829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:44.511829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:44.511829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:44.511829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:44.511829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:46:44.511829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:46:44.511829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:46:44.511829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:46:44.511829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:46:44.511829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:46:44.511829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 08:46:44.511829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:46:44.511829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 439/856] 10.222.0.18 () {56 vars in 1102 bytes} [Mon May 2 08:46:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:44.516934 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba174d0c-ed81-4ef2-99cb-c72a237b79e3 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:44.611171 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba174d0c-ed81-4ef2-99cb-c72a237b79e3 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:44.644919 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6939b-b310-4764-9018-f7653c8159dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:44.645641 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6939b-b310-4764-9018-f7653c8159dd None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:44.645920 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6939b-b310-4764-9018-f7653c8159dd None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:44.646190 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6939b-b310-4764-9018-f7653c8159dd None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:44.647072 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6939b-b310-4764-9018-f7653c8159dd None admin] RBAC: Adding query filter params (name=service) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:44.647236 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6939b-b310-4764-9018-f7653c8159dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:44.648645 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6939b-b310-4764-9018-f7653c8159dd None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:44.657129 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 418/857] 10.222.0.18 () {56 vars in 1103 bytes} [Mon May 2 08:46:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:44.662957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4a538-ab32-466b-8fb1-379f122adeee None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:44.759515 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4a538-ab32-466b-8fb1-379f122adeee None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:44.790620 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0d12d-576e-40d0-8514-846aa3000afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:44.791400 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0d12d-576e-40d0-8514-846aa3000afb None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:44.791682 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0d12d-576e-40d0-8514-846aa3000afb None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:44.791956 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0d12d-576e-40d0-8514-846aa3000afb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:44.802179 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0d12d-576e-40d0-8514-846aa3000afb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:44.803617 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0d12d-576e-40d0-8514-846aa3000afb None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:44.821808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-23e0d12d-576e-40d0-8514-846aa3000afb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:44.821808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:44.821808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:44.821808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:44.821808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:44.821808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:44.821808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:44.821808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:44.821808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:44.821808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:44.821808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:44.821808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:44.821808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:46:44.821808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:46:44.821808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:46:44.827799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:46:44.827799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:44.827799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:44.827799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:44.827799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:44.827799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:44.827799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:44.827799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:44.827799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:46:44.827799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:44.827799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:44.827799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:44.827799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:44.827799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:44.827799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:44.827799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:44.827799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:44.828875 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:46:44.828875 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:46:44.828875 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:44.828875 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:46:44.828875 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 440/858] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:44.829161 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6939b-b310-4764-9018-f7653c8159dd None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:44.922727 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6939b-b310-4764-9018-f7653c8159dd None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:44.954912 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5190cf-c9ad-4b78-bbd7-577651b899d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:44.955638 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5190cf-c9ad-4b78-bbd7-577651b899d1 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:44.955919 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5190cf-c9ad-4b78-bbd7-577651b899d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:44.956222 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5190cf-c9ad-4b78-bbd7-577651b899d1 None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:44.956939 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5190cf-c9ad-4b78-bbd7-577651b899d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:44.957243 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5190cf-c9ad-4b78-bbd7-577651b899d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:44.958615 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5190cf-c9ad-4b78-bbd7-577651b899d1 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:44.969999 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 419/859] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:44.975503 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0d12d-576e-40d0-8514-846aa3000afb None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:45.070614 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0d12d-576e-40d0-8514-846aa3000afb None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:45.103280 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a22e90-9bf3-4698-8d71-0864c3995f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:45.104084 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a22e90-9bf3-4698-8d71-0864c3995f50 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:45.104364 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a22e90-9bf3-4698-8d71-0864c3995f50 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:45.104632 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a22e90-9bf3-4698-8d71-0864c3995f50 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:45.112365 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a22e90-9bf3-4698-8d71-0864c3995f50 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:45.113811 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a22e90-9bf3-4698-8d71-0864c3995f50 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:45.128234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-65a22e90-9bf3-4698-8d71-0864c3995f50 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 02 08:46:45.128234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:45.128234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:45.128234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:45.128234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:45.128234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:45.128234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:45.128234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:45.128234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:45.128234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:45.128234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:45.128234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:45.128234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:46:45.128234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:46:45.128234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:46:45.128234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:46:45.129928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:45.129928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:45.129928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:46:45.129928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:46:45.129928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:46:45.129928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:46:45.129928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:45.129928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:45.129928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:45.129928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:45.129928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:45.129928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:46:45.129928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:45.129928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:45.129928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:45.129928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:45.129928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:45.129928 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:45.130996 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:45.130996 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:45.130996 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:46:45.130996 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:46:45.130996 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:46:45.130996 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:46:45.130996 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:46:45.130996 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:46:45.130996 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 02 08:46:45.130996 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:46:45.130996 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 441/860] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:45.135226 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5190cf-c9ad-4b78-bbd7-577651b899d1 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:45.230090 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5190cf-c9ad-4b78-bbd7-577651b899d1 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:45.262193 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd444c8-417e-48f3-af47-7aba944c6437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:45.263019 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd444c8-417e-48f3-af47-7aba944c6437 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:45.263324 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd444c8-417e-48f3-af47-7aba944c6437 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:45.263596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd444c8-417e-48f3-af47-7aba944c6437 None admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:45.264444 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd444c8-417e-48f3-af47-7aba944c6437 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:45.264748 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd444c8-417e-48f3-af47-7aba944c6437 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:45.266172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd444c8-417e-48f3-af47-7aba944c6437 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:45.283206 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 420/861] 10.222.0.18 () {56 vars in 1143 bytes} [Mon May 2 08:46:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:45.288980 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a22e90-9bf3-4698-8d71-0864c3995f50 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:45.385884 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a22e90-9bf3-4698-8d71-0864c3995f50 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:45.419228 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2b64d-583e-4bf6-b28a-08e9e3285055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:45.419868 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2b64d-583e-4bf6-b28a-08e9e3285055 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:45.420186 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2b64d-583e-4bf6-b28a-08e9e3285055 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:45.420466 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2b64d-583e-4bf6-b28a-08e9e3285055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:45.485512 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2b64d-583e-4bf6-b28a-08e9e3285055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:45.487851 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2b64d-583e-4bf6-b28a-08e9e3285055 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:45.583824 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 442/862] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:46:45 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 08:46:45.589741 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd444c8-417e-48f3-af47-7aba944c6437 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:45.687634 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd444c8-417e-48f3-af47-7aba944c6437 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:45.720565 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3039e60-6018-4f2a-877d-6f47d77764bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:45.721307 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3039e60-6018-4f2a-877d-6f47d77764bb None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:45.721574 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3039e60-6018-4f2a-877d-6f47d77764bb None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:45.721848 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3039e60-6018-4f2a-877d-6f47d77764bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:45.731355 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3039e60-6018-4f2a-877d-6f47d77764bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:45.732839 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3039e60-6018-4f2a-877d-6f47d77764bb None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:45.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-c3039e60-6018-4f2a-877d-6f47d77764bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:45.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:45.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:45.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:45.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:45.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:45.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:45.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:45.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:45.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:45.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:45.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:45.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:46:45.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:46:45.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:46:45.751056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:46:45.751056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:45.751056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:45.751056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:45.751056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:45.751056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:45.751056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:45.751056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:45.751056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:46:45.751056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:45.751056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:45.751056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:45.751056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:45.751056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:45.751056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:45.751056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:45.751056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:45.752817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:46:45.752817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:46:45.752817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:45.752817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:46:45.752817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 421/863] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:46:45.757446 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2b64d-583e-4bf6-b28a-08e9e3285055 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:45.852064 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2b64d-583e-4bf6-b28a-08e9e3285055 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:45.884606 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e0b81-9bc0-4147-90a5-c88118ca34fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:45.885360 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e0b81-9bc0-4147-90a5-c88118ca34fe None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:45.885638 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e0b81-9bc0-4147-90a5-c88118ca34fe None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:45.885908 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e0b81-9bc0-4147-90a5-c88118ca34fe None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:45.886610 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e0b81-9bc0-4147-90a5-c88118ca34fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:45.886910 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e0b81-9bc0-4147-90a5-c88118ca34fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:45.888286 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e0b81-9bc0-4147-90a5-c88118ca34fe None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:45.899043 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 443/864] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:45.904627 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3039e60-6018-4f2a-877d-6f47d77764bb None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:46.002118 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3039e60-6018-4f2a-877d-6f47d77764bb None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:46.034788 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ff75f-43de-4298-8394-677fa44c17c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:46.035628 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ff75f-43de-4298-8394-677fa44c17c8 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:46.035910 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ff75f-43de-4298-8394-677fa44c17c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:46.036217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ff75f-43de-4298-8394-677fa44c17c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:46.042694 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ff75f-43de-4298-8394-677fa44c17c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:46.044164 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ff75f-43de-4298-8394-677fa44c17c8 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:46.058167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-198ff75f-43de-4298-8394-677fa44c17c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:46:46.058167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:46.058167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:46.058167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:46.058167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:46.058167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:46.058167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:46.058167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:46.058167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:46.058167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:46.058167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:46.058167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:46.058167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:46:46.058167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:46:46.058167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:46:46.060943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:46:46.060943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:46.060943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:46.060943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:46.060943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:46.060943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:46.060943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:46.060943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:46.060943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:46:46.060943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:46.060943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:46.060943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:46.060943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:46.060943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:46.060943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:46.060943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:46.060943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:46.062098 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:46:46.062098 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:46:46.062098 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:46:46.062098 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:46:46.062098 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:46:46.062098 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:46:46.062098 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:46:46.062098 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:46:46.062098 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 422/865] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:46:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:46.065489 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e0b81-9bc0-4147-90a5-c88118ca34fe None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:46.161493 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e0b81-9bc0-4147-90a5-c88118ca34fe None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:46.193625 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ad1d5-c5e8-4cc5-97d5-b66788dc8dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:46.194308 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ad1d5-c5e8-4cc5-97d5-b66788dc8dbd None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:46.194586 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ad1d5-c5e8-4cc5-97d5-b66788dc8dbd None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:46.194859 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ad1d5-c5e8-4cc5-97d5-b66788dc8dbd None admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:46.195913 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ad1d5-c5e8-4cc5-97d5-b66788dc8dbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:46.196248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ad1d5-c5e8-4cc5-97d5-b66788dc8dbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:46.197659 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ad1d5-c5e8-4cc5-97d5-b66788dc8dbd None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:46.210196 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 444/866] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:46:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:46.216375 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ff75f-43de-4298-8394-677fa44c17c8 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:46.314685 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ff75f-43de-4298-8394-677fa44c17c8 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:46.348690 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c9be0-8ddb-480d-92eb-b56111f29323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:46.349349 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c9be0-8ddb-480d-92eb-b56111f29323 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:46.349653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c9be0-8ddb-480d-92eb-b56111f29323 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:46.349929 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c9be0-8ddb-480d-92eb-b56111f29323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:46.350748 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c9be0-8ddb-480d-92eb-b56111f29323 None admin] RBAC: Adding query filter params (role.id=78258bf52d1f4340bb3f7eda6a73f71a, scope.project.id=758931ec3ed54a1eadf1b9a463fbb241, user.id=894ff70da3bb45ce858b2d34224eab93) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:46.351062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c9be0-8ddb-480d-92eb-b56111f29323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:46.352568 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c9be0-8ddb-480d-92eb-b56111f29323 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:46.358298 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 423/867] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:46:46 2022] GET /identity/v3/role_assignments?user.id=894ff70da3bb45ce858b2d34224eab93&scope.project.id=758931ec3ed54a1eadf1b9a463fbb241&role.id=78258bf52d1f4340bb3f7eda6a73f71a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:48.712030 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f95b0-d52a-4be8-a226-0a57f164b040 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:48.712617 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f95b0-d52a-4be8-a226-0a57f164b040 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:48.712617 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f95b0-d52a-4be8-a226-0a57f164b040 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:48.714012 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 445/868] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:46:48.719134 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6e39a-68b3-449a-ba8f-f3d1dde5c9b1 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:48.719553 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6e39a-68b3-449a-ba8f-f3d1dde5c9b1 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:48.719696 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6e39a-68b3-449a-ba8f-f3d1dde5c9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:48.736633 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-9ac6e39a-68b3-449a-ba8f-f3d1dde5c9b1 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:46:48.737806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-9ac6e39a-68b3-449a-ba8f-f3d1dde5c9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:46:48.801108 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 424/869] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:46:48 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:46:48.826742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f95b0-d52a-4be8-a226-0a57f164b040 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:48.924922 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f95b0-d52a-4be8-a226-0a57f164b040 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:48.958215 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec7ad4-25ea-4c64-823a-6e8d560924bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:48.958959 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec7ad4-25ea-4c64-823a-6e8d560924bf None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:48.959238 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec7ad4-25ea-4c64-823a-6e8d560924bf None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:48.959508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec7ad4-25ea-4c64-823a-6e8d560924bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:48.969165 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec7ad4-25ea-4c64-823a-6e8d560924bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:46:48.977147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-50ec7ad4-25ea-4c64-823a-6e8d560924bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:46:48.977147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:48.977147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:48.977147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:48.977147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:48.977147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:48.977147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:48.977147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:48.977147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:48.977147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:48.977147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:48.977147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:48.977147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:46:48.977147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:46:48.977147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:46:48.977147 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:46:48.978274 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:46:48.978274 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:46:48.978274 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:46:48.978274 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:46:48.978274 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:48.978274 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:48.978274 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:48.978274 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:48.978274 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:48.978274 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:48.978274 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:48.978274 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:46:48.978274 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:48.978274 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:48.978274 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:48.978274 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:48.979514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:48.979514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:48.979514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:48.979514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:48.979514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:46:48.979514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:46:48.979514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:46:48.979514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:46:48.979514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:46:48.979514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:46:48.979514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:46:48.979514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:46:48.979514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 446/870] 10.222.0.18 () {56 vars in 1096 bytes} [Mon May 2 08:46:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:48.984293 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6e39a-68b3-449a-ba8f-f3d1dde5c9b1 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:49.079027 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6e39a-68b3-449a-ba8f-f3d1dde5c9b1 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:49.111257 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f65f00-ddf3-4c75-925f-5a21ffd02122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:49.111922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f65f00-ddf3-4c75-925f-5a21ffd02122 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:49.112237 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f65f00-ddf3-4c75-925f-5a21ffd02122 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:49.112517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f65f00-ddf3-4c75-925f-5a21ffd02122 None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:49.113252 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f65f00-ddf3-4c75-925f-5a21ffd02122 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:49.113562 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f65f00-ddf3-4c75-925f-5a21ffd02122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:49.114932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f65f00-ddf3-4c75-925f-5a21ffd02122 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:49.122591 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 425/871] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:46:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 08:46:49.128471 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec7ad4-25ea-4c64-823a-6e8d560924bf None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:49.226372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec7ad4-25ea-4c64-823a-6e8d560924bf None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:49.258970 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2253309-f5b1-4c0b-9096-b4bff0f993c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:49.259748 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2253309-f5b1-4c0b-9096-b4bff0f993c6 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:49.260031 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2253309-f5b1-4c0b-9096-b4bff0f993c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:49.260338 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2253309-f5b1-4c0b-9096-b4bff0f993c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:49.271191 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2253309-f5b1-4c0b-9096-b4bff0f993c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:49.272680 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2253309-f5b1-4c0b-9096-b4bff0f993c6 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:49.290398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-c2253309-f5b1-4c0b-9096-b4bff0f993c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:49.290398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:49.290398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:49.290398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:49.290398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:49.290398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:49.290398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:49.290398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:49.290398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:49.290398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:49.290398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:49.290398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:49.290398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:46:49.290398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:46:49.290398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:46:49.291461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:46:49.291461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:49.291461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:49.291461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:49.291461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:49.291461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:49.291461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:49.291461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:49.291461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:46:49.291461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:49.291461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:49.291461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:49.291461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:49.291461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:49.291461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:49.291461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:49.291461 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:49.292500 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:46:49.292500 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:46:49.292500 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:49.292500 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:46:49.292500 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 447/872] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:49.297429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f65f00-ddf3-4c75-925f-5a21ffd02122 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:49.392970 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f65f00-ddf3-4c75-925f-5a21ffd02122 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:49.425114 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e235c5-3ea7-4db5-b122-61f78f717cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:49.425771 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e235c5-3ea7-4db5-b122-61f78f717cd5 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:49.426056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e235c5-3ea7-4db5-b122-61f78f717cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:49.426332 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e235c5-3ea7-4db5-b122-61f78f717cd5 None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:49.427047 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e235c5-3ea7-4db5-b122-61f78f717cd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:49.427355 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e235c5-3ea7-4db5-b122-61f78f717cd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:49.428761 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e235c5-3ea7-4db5-b122-61f78f717cd5 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:49.440117 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 426/873] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:49.446054 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2253309-f5b1-4c0b-9096-b4bff0f993c6 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:49.542881 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2253309-f5b1-4c0b-9096-b4bff0f993c6 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:49.574785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985aa14-31aa-4d18-b749-344800315513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:49.575581 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985aa14-31aa-4d18-b749-344800315513 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:49.575864 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985aa14-31aa-4d18-b749-344800315513 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:49.576171 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985aa14-31aa-4d18-b749-344800315513 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:49.583907 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985aa14-31aa-4d18-b749-344800315513 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:49.585388 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985aa14-31aa-4d18-b749-344800315513 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:49.599467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-b985aa14-31aa-4d18-b749-344800315513 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 02 08:46:49.599467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:49.599467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:49.599467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:49.599467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:49.599467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:49.599467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:49.599467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:49.599467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:49.599467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:49.599467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:49.599467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:49.599467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:46:49.599467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:46:49.599467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:46:49.599467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:46:49.600608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:49.600608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:49.600608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:46:49.600608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:46:49.600608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:46:49.600608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:46:49.600608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:49.600608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:49.600608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:49.600608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:49.600608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:49.600608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:46:49.600608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:49.600608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:49.600608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:49.600608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:49.600608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:49.600608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:49.602001 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:49.602001 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:49.602001 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:46:49.602001 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:46:49.602001 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:46:49.602001 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:46:49.602001 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:46:49.602001 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:46:49.602001 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 02 08:46:49.602001 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:46:49.602001 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 448/874] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:49.606376 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e235c5-3ea7-4db5-b122-61f78f717cd5 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:49.703971 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e235c5-3ea7-4db5-b122-61f78f717cd5 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:49.737197 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745f294-193f-44de-9c8b-abbffd60ea8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:49.737880 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745f294-193f-44de-9c8b-abbffd60ea8d None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:49.738155 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745f294-193f-44de-9c8b-abbffd60ea8d None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:49.738429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745f294-193f-44de-9c8b-abbffd60ea8d None admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:49.739265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745f294-193f-44de-9c8b-abbffd60ea8d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:49.739573 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745f294-193f-44de-9c8b-abbffd60ea8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:49.741100 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745f294-193f-44de-9c8b-abbffd60ea8d None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:49.758297 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 427/875] 10.222.0.18 () {56 vars in 1143 bytes} [Mon May 2 08:46:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:49.764180 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985aa14-31aa-4d18-b749-344800315513 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:49.859540 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985aa14-31aa-4d18-b749-344800315513 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:49.890827 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031eb847-a351-4f4b-972d-01c1c8fbe899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:49.891386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031eb847-a351-4f4b-972d-01c1c8fbe899 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:49.891664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031eb847-a351-4f4b-972d-01c1c8fbe899 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:49.892703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031eb847-a351-4f4b-972d-01c1c8fbe899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:49.955249 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031eb847-a351-4f4b-972d-01c1c8fbe899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:49.956819 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031eb847-a351-4f4b-972d-01c1c8fbe899 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:50.047512 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 449/876] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:46:49 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 08:46:50.053345 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745f294-193f-44de-9c8b-abbffd60ea8d None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:50.149052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745f294-193f-44de-9c8b-abbffd60ea8d None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:50.182139 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbc7b2-33ee-4433-a22f-95e08c72b6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:50.183054 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbc7b2-33ee-4433-a22f-95e08c72b6e6 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:50.183387 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbc7b2-33ee-4433-a22f-95e08c72b6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:50.183687 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbc7b2-33ee-4433-a22f-95e08c72b6e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:50.193642 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbc7b2-33ee-4433-a22f-95e08c72b6e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:50.195147 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbc7b2-33ee-4433-a22f-95e08c72b6e6 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:50.212953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-10dbc7b2-33ee-4433-a22f-95e08c72b6e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:50.212953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:50.212953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:50.212953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:50.212953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:50.212953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:50.212953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:50.212953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:50.212953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:50.212953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:50.212953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:50.212953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:50.212953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:46:50.212953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:46:50.212953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:46:50.213990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:46:50.213990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:50.213990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:50.213990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:50.213990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:50.213990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:50.213990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:50.213990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:50.213990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:46:50.213990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:50.213990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:50.213990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:50.213990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:50.213990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:50.213990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:50.213990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:50.213990 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:50.215203 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:46:50.215203 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:46:50.215203 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:50.215203 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:46:50.215203 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 428/877] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:50.219952 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031eb847-a351-4f4b-972d-01c1c8fbe899 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:50.315729 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031eb847-a351-4f4b-972d-01c1c8fbe899 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:50.348330 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51235996-a5a0-4a1f-b133-1becc3c48de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:50.348904 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51235996-a5a0-4a1f-b133-1becc3c48de5 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:50.349194 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51235996-a5a0-4a1f-b133-1becc3c48de5 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:50.349470 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51235996-a5a0-4a1f-b133-1becc3c48de5 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:50.350243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51235996-a5a0-4a1f-b133-1becc3c48de5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:50.350503 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51235996-a5a0-4a1f-b133-1becc3c48de5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:50.351891 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51235996-a5a0-4a1f-b133-1becc3c48de5 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:50.363127 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 450/878] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:50.368899 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbc7b2-33ee-4433-a22f-95e08c72b6e6 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:50.465496 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbc7b2-33ee-4433-a22f-95e08c72b6e6 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:50.497697 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f8e6c-e625-4765-971a-db9cd34e3898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:50.498489 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f8e6c-e625-4765-971a-db9cd34e3898 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:50.498769 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f8e6c-e625-4765-971a-db9cd34e3898 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:50.499039 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f8e6c-e625-4765-971a-db9cd34e3898 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:50.506218 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f8e6c-e625-4765-971a-db9cd34e3898 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:50.507673 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f8e6c-e625-4765-971a-db9cd34e3898 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:50.521659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-b06f8e6c-e625-4765-971a-db9cd34e3898 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:46:50.521659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:50.521659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:50.521659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:50.521659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:50.521659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:50.521659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:50.521659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:50.521659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:50.521659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:50.521659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:50.521659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:50.521659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:46:50.521659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:46:50.521659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:46:50.526693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:46:50.526693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:50.526693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:50.526693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:50.526693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:50.526693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:50.526693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:50.526693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:50.526693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:46:50.526693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:50.526693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:50.526693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:50.526693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:50.526693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:50.526693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:50.526693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:50.526693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:50.527792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:46:50.527792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:46:50.527792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:46:50.527792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:46:50.527792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:46:50.527792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:46:50.527792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:46:50.527792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:46:50.527792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 429/879] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:46:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:50.528899 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51235996-a5a0-4a1f-b133-1becc3c48de5 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:50.623367 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51235996-a5a0-4a1f-b133-1becc3c48de5 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:50.655776 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e09e8-579c-4140-b49a-d00e25542bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:50.656510 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e09e8-579c-4140-b49a-d00e25542bb1 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:50.656783 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e09e8-579c-4140-b49a-d00e25542bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:50.657058 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e09e8-579c-4140-b49a-d00e25542bb1 None admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:50.658079 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e09e8-579c-4140-b49a-d00e25542bb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:50.658398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e09e8-579c-4140-b49a-d00e25542bb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:50.659832 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e09e8-579c-4140-b49a-d00e25542bb1 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:50.671558 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 451/880] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:46:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:50.678163 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f8e6c-e625-4765-971a-db9cd34e3898 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:50.774331 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f8e6c-e625-4765-971a-db9cd34e3898 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:50.806859 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6accc5-4e2c-4120-a3c1-0499697b9d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:50.807516 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6accc5-4e2c-4120-a3c1-0499697b9d93 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:50.807817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6accc5-4e2c-4120-a3c1-0499697b9d93 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:50.808136 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6accc5-4e2c-4120-a3c1-0499697b9d93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:50.808967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6accc5-4e2c-4120-a3c1-0499697b9d93 None admin] RBAC: Adding query filter params (role.id=509216a314244b96b05d3fe56b0d9cd1, scope.project.id=758931ec3ed54a1eadf1b9a463fbb241, user.id=894ff70da3bb45ce858b2d34224eab93) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:50.809281 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6accc5-4e2c-4120-a3c1-0499697b9d93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:50.810781 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6accc5-4e2c-4120-a3c1-0499697b9d93 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:50.816985 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 430/881] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:46:50 2022] GET /identity/v3/role_assignments?user.id=894ff70da3bb45ce858b2d34224eab93&scope.project.id=758931ec3ed54a1eadf1b9a463fbb241&role.id=509216a314244b96b05d3fe56b0d9cd1 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:53.102043 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91003d18-70c2-48de-988f-4d68a8935104 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:53.102568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91003d18-70c2-48de-988f-4d68a8935104 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:53.102568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91003d18-70c2-48de-988f-4d68a8935104 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:53.103884 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 452/882] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:46:53.109252 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05307e9-e51b-4af6-bcfe-34691a38174e None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:53.109672 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05307e9-e51b-4af6-bcfe-34691a38174e None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:53.109808 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05307e9-e51b-4af6-bcfe-34691a38174e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:53.128074 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-b05307e9-e51b-4af6-bcfe-34691a38174e None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:46:53.130581 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-b05307e9-e51b-4af6-bcfe-34691a38174e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:46:53.200576 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 431/883] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:46:53 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:46:53.225155 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91003d18-70c2-48de-988f-4d68a8935104 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:53.325353 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91003d18-70c2-48de-988f-4d68a8935104 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:53.358089 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60c973-a662-4924-ac60-29c0237973dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:53.358810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60c973-a662-4924-ac60-29c0237973dc None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:53.359134 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60c973-a662-4924-ac60-29c0237973dc None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:53.359439 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60c973-a662-4924-ac60-29c0237973dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:53.369650 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60c973-a662-4924-ac60-29c0237973dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:46:53.377836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-5f60c973-a662-4924-ac60-29c0237973dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:46:53.377836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:53.377836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:53.377836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:53.377836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:53.377836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:53.377836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:53.377836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:53.377836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:53.377836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:53.377836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:53.377836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:53.377836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:46:53.377836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:46:53.377836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:46:53.377836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:46:53.382611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:46:53.382611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:46:53.382611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:46:53.382611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:46:53.382611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:53.382611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:53.382611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:53.382611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:53.382611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:53.382611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:53.382611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:53.382611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:46:53.382611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:53.382611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:53.382611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:53.382611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:53.383453 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:53.383453 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:53.383453 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:53.383453 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:53.383453 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:46:53.383453 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:46:53.383453 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:46:53.383453 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:46:53.383453 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:46:53.383453 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:46:53.383453 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:46:53.383453 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:46:53.383453 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 453/884] 10.222.0.18 () {56 vars in 1096 bytes} [Mon May 2 08:46:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:53.385431 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05307e9-e51b-4af6-bcfe-34691a38174e None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:53.480679 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05307e9-e51b-4af6-bcfe-34691a38174e None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:53.515077 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b6a65-9b48-4939-b3c1-ee883b12009c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:53.515744 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b6a65-9b48-4939-b3c1-ee883b12009c None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:53.516028 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b6a65-9b48-4939-b3c1-ee883b12009c None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:53.516339 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b6a65-9b48-4939-b3c1-ee883b12009c None admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:53.517079 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b6a65-9b48-4939-b3c1-ee883b12009c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:53.517386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b6a65-9b48-4939-b3c1-ee883b12009c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:53.518777 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b6a65-9b48-4939-b3c1-ee883b12009c None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:53.526581 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 432/885] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:46:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:53.533022 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60c973-a662-4924-ac60-29c0237973dc None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:53.631678 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60c973-a662-4924-ac60-29c0237973dc None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:53.664523 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aeec4-ba34-4c7c-abfd-24c027e8c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:53.665311 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aeec4-ba34-4c7c-abfd-24c027e8c5e9 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:53.665591 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aeec4-ba34-4c7c-abfd-24c027e8c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:53.665863 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aeec4-ba34-4c7c-abfd-24c027e8c5e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:53.676773 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aeec4-ba34-4c7c-abfd-24c027e8c5e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:53.678279 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aeec4-ba34-4c7c-abfd-24c027e8c5e9 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:53.695209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-3c3aeec4-ba34-4c7c-abfd-24c027e8c5e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:53.695209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:53.695209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:53.695209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:53.695209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:53.695209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:53.695209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:53.695209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:53.695209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:53.695209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:53.695209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:53.695209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:53.695209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:46:53.695209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:46:53.695209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:46:53.696543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:46:53.696543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:53.696543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:53.696543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:53.696543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:53.696543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:53.696543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:53.696543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:53.696543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:46:53.696543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:53.696543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:53.696543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:53.696543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:53.696543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:53.696543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:53.696543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:53.696543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:53.702197 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:46:53.702197 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:46:53.702197 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:53.702197 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:46:53.702197 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 454/886] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:53.702503 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b6a65-9b48-4939-b3c1-ee883b12009c None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:53.800263 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b6a65-9b48-4939-b3c1-ee883b12009c None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:53.832362 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e947c2-c230-40f4-92d4-a89662f07afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:53.833023 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e947c2-c230-40f4-92d4-a89662f07afd None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:53.833333 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e947c2-c230-40f4-92d4-a89662f07afd None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:53.833610 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e947c2-c230-40f4-92d4-a89662f07afd None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:53.834345 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e947c2-c230-40f4-92d4-a89662f07afd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:53.834686 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e947c2-c230-40f4-92d4-a89662f07afd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:53.836110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e947c2-c230-40f4-92d4-a89662f07afd None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:53.848301 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 433/887] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:53.854526 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aeec4-ba34-4c7c-abfd-24c027e8c5e9 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:53.951593 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aeec4-ba34-4c7c-abfd-24c027e8c5e9 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:53.982732 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99afa0-4a45-4bf0-8727-8d5a1ec6d5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:53.983517 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99afa0-4a45-4bf0-8727-8d5a1ec6d5ee None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:53.983799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99afa0-4a45-4bf0-8727-8d5a1ec6d5ee None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:53.984090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99afa0-4a45-4bf0-8727-8d5a1ec6d5ee None admin] PATH_INFO: `/v3/users/placement` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:53.991828 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99afa0-4a45-4bf0-8727-8d5a1ec6d5ee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:53.993354 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99afa0-4a45-4bf0-8727-8d5a1ec6d5ee None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:54.007893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-5a99afa0-4a45-4bf0-8727-8d5a1ec6d5ee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 02 08:46:54.007893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:54.007893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:54.007893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:54.007893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:54.007893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:54.007893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:54.007893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:54.007893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:54.007893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:54.007893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:54.007893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:54.007893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:46:54.007893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:46:54.007893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:46:54.007893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:46:54.009066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:54.009066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:54.009066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:46:54.009066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:46:54.009066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:46:54.009066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:46:54.009066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:54.009066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:54.009066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:54.009066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:54.009066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:54.009066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:46:54.009066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:54.009066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:54.009066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:54.009066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:54.009066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:54.009066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:54.010262 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:54.010262 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:54.010262 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:46:54.010262 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:46:54.010262 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:46:54.010262 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:46:54.010262 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:46:54.010262 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:46:54.010262 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 02 08:46:54.010262 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:46:54.010262 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 455/888] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:54.014922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e947c2-c230-40f4-92d4-a89662f07afd None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:54.110446 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e947c2-c230-40f4-92d4-a89662f07afd None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:54.143716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6272b30-6456-4567-8a1c-e3e28844594c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:54.144423 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6272b30-6456-4567-8a1c-e3e28844594c None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:54.144699 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6272b30-6456-4567-8a1c-e3e28844594c None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:54.144972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6272b30-6456-4567-8a1c-e3e28844594c None admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:54.145788 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6272b30-6456-4567-8a1c-e3e28844594c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:54.146097 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6272b30-6456-4567-8a1c-e3e28844594c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:54.147539 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6272b30-6456-4567-8a1c-e3e28844594c None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:54.164417 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 434/889] 10.222.0.18 () {56 vars in 1143 bytes} [Mon May 2 08:46:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:54.170197 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99afa0-4a45-4bf0-8727-8d5a1ec6d5ee None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:54.268371 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99afa0-4a45-4bf0-8727-8d5a1ec6d5ee None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:54.300149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4279634-932b-4787-a16e-d61e45944f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:54.300931 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4279634-932b-4787-a16e-d61e45944f75 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:54.301209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4279634-932b-4787-a16e-d61e45944f75 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:54.301478 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4279634-932b-4787-a16e-d61e45944f75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:54.311479 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4279634-932b-4787-a16e-d61e45944f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:54.312954 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4279634-932b-4787-a16e-d61e45944f75 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:54.331078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-a4279634-932b-4787-a16e-d61e45944f75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:54.331078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:54.331078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:54.331078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:54.331078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:54.331078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:54.331078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:54.331078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:54.331078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:54.331078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:54.331078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:54.331078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:54.331078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:46:54.331078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:46:54.331078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:46:54.332037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:46:54.332037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:54.332037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:54.332037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:54.332037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:54.332037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:54.332037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:54.332037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:54.332037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:46:54.332037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:54.332037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:54.332037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:54.332037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:54.332037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:54.332037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:54.332037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:54.332037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:54.333181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:46:54.333181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:46:54.333181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:54.333181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:46:54.333181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 456/890] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:54.337941 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6272b30-6456-4567-8a1c-e3e28844594c None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:54.432002 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6272b30-6456-4567-8a1c-e3e28844594c None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:54.464556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c85ee-3de3-48a1-9492-b08ede2574b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:54.465207 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c85ee-3de3-48a1-9492-b08ede2574b1 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:54.465487 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c85ee-3de3-48a1-9492-b08ede2574b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:54.465759 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c85ee-3de3-48a1-9492-b08ede2574b1 None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:54.466465 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c85ee-3de3-48a1-9492-b08ede2574b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:54.466768 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c85ee-3de3-48a1-9492-b08ede2574b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:54.468236 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c85ee-3de3-48a1-9492-b08ede2574b1 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:54.479132 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 435/891] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:54.484774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4279634-932b-4787-a16e-d61e45944f75 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:54.580829 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4279634-932b-4787-a16e-d61e45944f75 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:54.613725 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa459d-ee49-44e2-a712-cedab81e81a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:54.614503 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa459d-ee49-44e2-a712-cedab81e81a9 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:54.614781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa459d-ee49-44e2-a712-cedab81e81a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:54.615051 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa459d-ee49-44e2-a712-cedab81e81a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:54.621406 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa459d-ee49-44e2-a712-cedab81e81a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:54.622893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa459d-ee49-44e2-a712-cedab81e81a9 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:54.636669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-39aa459d-ee49-44e2-a712-cedab81e81a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:46:54.636669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:54.636669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:54.636669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:54.636669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:54.636669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:54.636669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:54.636669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:54.636669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:54.636669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:54.636669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:54.636669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:54.636669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:46:54.636669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:46:54.636669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:46:54.637739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:46:54.637739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:54.637739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:54.637739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:54.637739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:54.637739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:54.637739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:54.637739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:54.637739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:46:54.637739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:54.637739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:54.637739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:54.637739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:54.637739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:54.637739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:54.637739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:54.637739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:54.638659 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:46:54.638659 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:46:54.638659 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:46:54.638659 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:46:54.638659 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:46:54.638659 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:46:54.638659 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:46:54.638659 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:46:54.638659 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 457/892] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:46:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:54.644467 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c85ee-3de3-48a1-9492-b08ede2574b1 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:54.741259 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c85ee-3de3-48a1-9492-b08ede2574b1 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:54.774085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca20ee-7732-4a3e-9e22-ec44a2a7ad0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:54.774739 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca20ee-7732-4a3e-9e22-ec44a2a7ad0a None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:54.775020 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca20ee-7732-4a3e-9e22-ec44a2a7ad0a None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:54.775294 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca20ee-7732-4a3e-9e22-ec44a2a7ad0a None admin] PATH_INFO: `/v3/projects` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:54.776094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca20ee-7732-4a3e-9e22-ec44a2a7ad0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:54.776404 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca20ee-7732-4a3e-9e22-ec44a2a7ad0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:54.777841 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca20ee-7732-4a3e-9e22-ec44a2a7ad0a None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:54.789228 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 436/893] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:46:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:54.795379 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa459d-ee49-44e2-a712-cedab81e81a9 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:54.892951 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa459d-ee49-44e2-a712-cedab81e81a9 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:54.924485 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeda8ba-6d5a-47ca-9abd-aa1206ef23fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:54.925392 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeda8ba-6d5a-47ca-9abd-aa1206ef23fe None admin] REQUEST_METHOD: `PUT` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:54.925688 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeda8ba-6d5a-47ca-9abd-aa1206ef23fe None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:54.931491 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeda8ba-6d5a-47ca-9abd-aa1206ef23fe None admin] PATH_INFO: `/v3/projects/758931ec3ed54a1eadf1b9a463fbb241/users/894ff70da3bb45ce858b2d34224eab93/roles/509216a314244b96b05d3fe56b0d9cd1` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:54.931491 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeda8ba-6d5a-47ca-9abd-aa1206ef23fe None admin] RBAC: Authorizing `identity:create_grant(project_id=758931ec3ed54a1eadf1b9a463fbb241, user_id=894ff70da3bb45ce858b2d34224eab93, role_id=509216a314244b96b05d3fe56b0d9cd1)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:54.931491 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeda8ba-6d5a-47ca-9abd-aa1206ef23fe None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:55.033609 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 458/894] 10.222.0.18 () {58 vars in 1439 bytes} [Mon May 2 08:46:54 2022] PUT /identity/v3/projects/758931ec3ed54a1eadf1b9a463fbb241/users/894ff70da3bb45ce858b2d34224eab93/roles/509216a314244b96b05d3fe56b0d9cd1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:46:57.395815 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e3cfe-6419-4bb4-9352-af6346e91fed None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:57.396421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e3cfe-6419-4bb4-9352-af6346e91fed None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:57.396421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e3cfe-6419-4bb4-9352-af6346e91fed None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:57.398040 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 437/895] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:46:57.403291 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab6128-34e3-49f5-93a8-378b45c2a68a None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:57.403726 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab6128-34e3-49f5-93a8-378b45c2a68a None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:57.403913 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab6128-34e3-49f5-93a8-378b45c2a68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:57.421457 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-4cab6128-34e3-49f5-93a8-378b45c2a68a None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:46:57.422641 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-4cab6128-34e3-49f5-93a8-378b45c2a68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:46:57.487289 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 459/896] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:46:57 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:46:57.511729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e3cfe-6419-4bb4-9352-af6346e91fed None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:57.610006 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e3cfe-6419-4bb4-9352-af6346e91fed None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:57.643300 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c26a6-6a72-41b8-9daf-870e0db11518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:57.644137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c26a6-6a72-41b8-9daf-870e0db11518 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:57.644408 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c26a6-6a72-41b8-9daf-870e0db11518 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:57.644681 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c26a6-6a72-41b8-9daf-870e0db11518 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:57.654945 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c26a6-6a72-41b8-9daf-870e0db11518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 08:46:57.663364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-ba2c26a6-6a72-41b8-9daf-870e0db11518 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:46:57.663364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:57.663364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:57.663364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:57.663364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:57.663364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:57.663364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:57.663364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:57.663364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:57.663364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:57.663364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:57.663364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:57.663364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 08:46:57.663364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 08:46:57.663364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 08:46:57.663364 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 08:46:57.664537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 08:46:57.664537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 08:46:57.664537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 08:46:57.664537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 08:46:57.664537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:57.664537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:57.664537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:57.664537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:57.664537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:57.664537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:57.664537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:57.664537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:46:57.664537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:57.664537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:57.664537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:57.664537 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:57.665794 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:57.665794 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:57.665794 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:57.665794 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:57.665794 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 08:46:57.665794 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 08:46:57.665794 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 08:46:57.665794 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 08:46:57.665794 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 08:46:57.665794 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 08:46:57.665794 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 08:46:57.665794 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:46:57.665794 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 438/897] 10.222.0.18 () {56 vars in 1096 bytes} [Mon May 2 08:46:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 08:46:57.670503 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab6128-34e3-49f5-93a8-378b45c2a68a None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:57.767366 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab6128-34e3-49f5-93a8-378b45c2a68a None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:57.798871 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0bf06-dfb6-438e-94e9-e8c323d91216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:57.799525 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0bf06-dfb6-438e-94e9-e8c323d91216 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:57.799806 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0bf06-dfb6-438e-94e9-e8c323d91216 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:57.800101 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0bf06-dfb6-438e-94e9-e8c323d91216 None admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:57.800838 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0bf06-dfb6-438e-94e9-e8c323d91216 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:57.801141 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0bf06-dfb6-438e-94e9-e8c323d91216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:57.802494 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0bf06-dfb6-438e-94e9-e8c323d91216 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:57.810119 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 460/898] 10.222.0.18 () {56 vars in 1099 bytes} [Mon May 2 08:46:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:57.816379 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c26a6-6a72-41b8-9daf-870e0db11518 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:57.914005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c26a6-6a72-41b8-9daf-870e0db11518 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:57.946508 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ed125-dd45-471c-b15f-94877f7d90ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:57.947295 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ed125-dd45-471c-b15f-94877f7d90ad None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:57.947584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ed125-dd45-471c-b15f-94877f7d90ad None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:57.947881 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ed125-dd45-471c-b15f-94877f7d90ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:57.959466 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ed125-dd45-471c-b15f-94877f7d90ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:57.961479 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ed125-dd45-471c-b15f-94877f7d90ad None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:57.977556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-b29ed125-dd45-471c-b15f-94877f7d90ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:57.977556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:57.977556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:57.977556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:57.977556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:57.977556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:57.977556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:57.977556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:57.977556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:57.977556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:57.977556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:57.977556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:57.977556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:46:57.977556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:46:57.977556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:46:57.979492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:46:57.979492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:57.979492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:57.979492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:57.979492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:57.979492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:57.979492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:57.979492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:57.979492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:46:57.979492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:57.979492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:57.979492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:57.979492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:57.979492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:57.979492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:57.979492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:57.979492 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:57.980750 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:46:57.980750 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:46:57.980750 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:57.980750 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:46:57.980750 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 439/899] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:57.984577 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0bf06-dfb6-438e-94e9-e8c323d91216 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:58.081786 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0bf06-dfb6-438e-94e9-e8c323d91216 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:58.114703 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdcf70-a264-477f-b868-753c5a09b2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:58.115774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdcf70-a264-477f-b868-753c5a09b2a0 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:58.116287 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdcf70-a264-477f-b868-753c5a09b2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:58.116748 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdcf70-a264-477f-b868-753c5a09b2a0 None admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:58.118009 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdcf70-a264-477f-b868-753c5a09b2a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:58.118525 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdcf70-a264-477f-b868-753c5a09b2a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:58.120970 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdcf70-a264-477f-b868-753c5a09b2a0 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:58.135748 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 461/900] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:58.141500 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ed125-dd45-471c-b15f-94877f7d90ad None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:58.247240 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ed125-dd45-471c-b15f-94877f7d90ad None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:58.282565 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6e49a-23db-4491-9c0c-9b7da47f7d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:58.283619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6e49a-23db-4491-9c0c-9b7da47f7d82 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:58.283915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6e49a-23db-4491-9c0c-9b7da47f7d82 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:58.284192 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6e49a-23db-4491-9c0c-9b7da47f7d82 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:58.292735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6e49a-23db-4491-9c0c-9b7da47f7d82 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:58.294212 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6e49a-23db-4491-9c0c-9b7da47f7d82 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:58.310393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-01a6e49a-23db-4491-9c0c-9b7da47f7d82 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 02 08:46:58.310393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:58.310393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:58.310393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:58.310393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:58.310393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:58.310393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:58.310393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:58.310393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:58.310393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:58.310393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:58.310393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:58.310393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 08:46:58.310393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 08:46:58.310393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 08:46:58.310393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 08:46:58.312915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:58.312915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:58.312915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 08:46:58.312915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:46:58.312915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 08:46:58.312915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 08:46:58.312915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:58.312915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:58.312915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:58.312915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:58.312915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:58.312915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:46:58.312915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:58.312915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:58.312915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:58.312915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:58.312915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:58.312915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:58.315062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:58.315062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:58.315062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 08:46:58.315062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 08:46:58.315062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 08:46:58.315062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 08:46:58.315062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 08:46:58.315062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 08:46:58.315062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 02 08:46:58.315062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:46:58.315062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 440/901] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:58.318661 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdcf70-a264-477f-b868-753c5a09b2a0 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:58.426070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdcf70-a264-477f-b868-753c5a09b2a0 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:58.462692 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8793c-0cdc-498d-8ec5-aa36a74e58f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:58.463384 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8793c-0cdc-498d-8ec5-aa36a74e58f1 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:58.463670 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8793c-0cdc-498d-8ec5-aa36a74e58f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:58.463946 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8793c-0cdc-498d-8ec5-aa36a74e58f1 None admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:58.464842 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8793c-0cdc-498d-8ec5-aa36a74e58f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:58.465156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8793c-0cdc-498d-8ec5-aa36a74e58f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:58.466635 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8793c-0cdc-498d-8ec5-aa36a74e58f1 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:58.486797 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 462/902] 10.222.0.18 () {56 vars in 1143 bytes} [Mon May 2 08:46:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:58.492607 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6e49a-23db-4491-9c0c-9b7da47f7d82 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:58.594365 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6e49a-23db-4491-9c0c-9b7da47f7d82 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:58.627505 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cd48d-a6db-4838-882a-ce738d3c6062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:58.628173 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cd48d-a6db-4838-882a-ce738d3c6062 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:58.628454 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cd48d-a6db-4838-882a-ce738d3c6062 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:58.628727 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cd48d-a6db-4838-882a-ce738d3c6062 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:58.696793 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cd48d-a6db-4838-882a-ce738d3c6062 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:58.698299 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cd48d-a6db-4838-882a-ce738d3c6062 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:58.792591 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 441/903] 10.222.0.18 () {58 vars in 1282 bytes} [Mon May 2 08:46:58 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 08:46:58.799143 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8793c-0cdc-498d-8ec5-aa36a74e58f1 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:58.895136 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8793c-0cdc-498d-8ec5-aa36a74e58f1 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:58.927916 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c03f0-229e-41cf-ba1a-d8ad5d055f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:58.928732 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c03f0-229e-41cf-ba1a-d8ad5d055f67 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:58.929021 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c03f0-229e-41cf-ba1a-d8ad5d055f67 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:58.929351 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c03f0-229e-41cf-ba1a-d8ad5d055f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:58.939339 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c03f0-229e-41cf-ba1a-d8ad5d055f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:58.940881 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c03f0-229e-41cf-ba1a-d8ad5d055f67 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:58.958986 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-c68c03f0-229e-41cf-ba1a-d8ad5d055f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:58.958986 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:58.958986 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:58.958986 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:58.958986 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:58.958986 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:58.958986 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:58.958986 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:58.958986 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:58.958986 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:58.958986 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:58.958986 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:58.958986 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 08:46:58.958986 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 08:46:58.958986 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 08:46:58.960090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 08:46:58.960090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:58.960090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:58.960090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:58.960090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:58.960090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:58.960090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:58.960090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:58.960090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:46:58.960090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:58.960090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:58.960090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:58.960090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:58.960090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:58.960090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:58.960090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:58.960090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:58.961148 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 08:46:58.961148 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 08:46:58.961148 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 08:46:58.961148 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:46:58.961148 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 463/904] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:46:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:58.965955 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cd48d-a6db-4838-882a-ce738d3c6062 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:59.061557 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cd48d-a6db-4838-882a-ce738d3c6062 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:59.093722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae60e7c-170d-4441-8c41-3551759c0521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:59.094372 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae60e7c-170d-4441-8c41-3551759c0521 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:59.094651 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae60e7c-170d-4441-8c41-3551759c0521 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:59.095728 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae60e7c-170d-4441-8c41-3551759c0521 None admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:59.096745 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae60e7c-170d-4441-8c41-3551759c0521 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:59.097103 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae60e7c-170d-4441-8c41-3551759c0521 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:59.098428 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae60e7c-170d-4441-8c41-3551759c0521 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:59.109363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 442/905] 10.222.0.18 () {56 vars in 1109 bytes} [Mon May 2 08:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:59.115452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c03f0-229e-41cf-ba1a-d8ad5d055f67 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:59.209987 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c03f0-229e-41cf-ba1a-d8ad5d055f67 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:59.242741 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402a9d5-b649-4280-b1b5-8720839c82f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:59.243584 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402a9d5-b649-4280-b1b5-8720839c82f0 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:59.243819 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402a9d5-b649-4280-b1b5-8720839c82f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:59.244121 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402a9d5-b649-4280-b1b5-8720839c82f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:59.250490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402a9d5-b649-4280-b1b5-8720839c82f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:59.252504 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402a9d5-b649-4280-b1b5-8720839c82f0 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:59.265618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application [None req-a402a9d5-b649-4280-b1b5-8720839c82f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:46:59.265618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:46:59.265618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:46:59.265618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:46:59.265618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:46:59.265618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:46:59.265618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:46:59.265618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:46:59.265618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:46:59.265618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:46:59.265618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:46:59.265618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:46:59.265618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 08:46:59.265618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 08:46:59.265618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 08:46:59.267013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 08:46:59.267013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:46:59.267013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:46:59.267013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:46:59.267013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:46:59.267013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:46:59.267013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:46:59.267013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:46:59.267013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application with Lock( May 02 08:46:59.267013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:46:59.267013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._enter() May 02 08:46:59.267013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:46:59.267013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:46:59.267013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:46:59.267013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.creator() May 02 08:46:59.267013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:46:59.267013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application created_value = creator( May 02 08:46:59.268187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 08:46:59.268187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 08:46:59.268187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 08:46:59.268187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 08:46:59.268187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 08:46:59.268187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 08:46:59.268187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 08:46:59.268187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: ERROR keystone.server.flask.application May 02 08:46:59.268187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 464/906] 10.222.0.18 () {56 vars in 1111 bytes} [Mon May 2 08:46:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:46:59.273017 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae60e7c-170d-4441-8c41-3551759c0521 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:59.369225 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae60e7c-170d-4441-8c41-3551759c0521 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:59.400608 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad33d8d-7217-4b0e-b66c-74d7eea712b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:59.401260 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad33d8d-7217-4b0e-b66c-74d7eea712b6 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:59.401539 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad33d8d-7217-4b0e-b66c-74d7eea712b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:59.401808 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad33d8d-7217-4b0e-b66c-74d7eea712b6 None admin] PATH_INFO: `/v3/projects` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:59.402572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad33d8d-7217-4b0e-b66c-74d7eea712b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:59.402878 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad33d8d-7217-4b0e-b66c-74d7eea712b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:59.404326 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad33d8d-7217-4b0e-b66c-74d7eea712b6 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:59.416479 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 443/907] 10.222.0.18 () {56 vars in 1148 bytes} [Mon May 2 08:46:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:46:59.422138 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402a9d5-b649-4280-b1b5-8720839c82f0 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:46:59.518197 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402a9d5-b649-4280-b1b5-8720839c82f0 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:46:59.550216 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f8400-d717-442b-9ed9-d64fdb7cefe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:46:59.550884 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f8400-d717-442b-9ed9-d64fdb7cefe7 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:46:59.551165 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f8400-d717-442b-9ed9-d64fdb7cefe7 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:46:59.551437 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f8400-d717-442b-9ed9-d64fdb7cefe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:46:59.552278 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f8400-d717-442b-9ed9-d64fdb7cefe7 None admin] RBAC: Adding query filter params (role.id=509216a314244b96b05d3fe56b0d9cd1, scope.project.id=758931ec3ed54a1eadf1b9a463fbb241, user.id=894ff70da3bb45ce858b2d34224eab93) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:46:59.552610 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f8400-d717-442b-9ed9-d64fdb7cefe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:46:59.554009 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f8400-d717-442b-9ed9-d64fdb7cefe7 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:46:59.559581 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 465/908] 10.222.0.18 () {56 vars in 1374 bytes} [Mon May 2 08:46:59 2022] GET /identity/v3/role_assignments?user.id=894ff70da3bb45ce858b2d34224eab93&scope.project.id=758931ec3ed54a1eadf1b9a463fbb241&role.id=509216a314244b96b05d3fe56b0d9cd1 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:47:01.876606 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1d4e1-d831-4af3-9fbe-48aa7dcd49a6 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:01.877137 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1d4e1-d831-4af3-9fbe-48aa7dcd49a6 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:01.877250 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1d4e1-d831-4af3-9fbe-48aa7dcd49a6 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:01.878542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 444/909] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:47:01.883574 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673f184-10f3-43bf-bcf4-2959e0291e88 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:01.883946 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673f184-10f3-43bf-bcf4-2959e0291e88 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:01.884202 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673f184-10f3-43bf-bcf4-2959e0291e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:01.901424 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-a673f184-10f3-43bf-bcf4-2959e0291e88 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:47:01.902684 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-a673f184-10f3-43bf-bcf4-2959e0291e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:47:01.965671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 466/910] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:47:01 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:47:01.989541 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1d4e1-d831-4af3-9fbe-48aa7dcd49a6 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:47:02.087667 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1d4e1-d831-4af3-9fbe-48aa7dcd49a6 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:47:02.119903 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043293f7-429f-48c9-84a6-ab43f79c8776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:47:02.120747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043293f7-429f-48c9-84a6-ab43f79c8776 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:02.121033 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043293f7-429f-48c9-84a6-ab43f79c8776 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:02.121307 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043293f7-429f-48c9-84a6-ab43f79c8776 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:02.121950 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043293f7-429f-48c9-84a6-ab43f79c8776 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:47:02.123329 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043293f7-429f-48c9-84a6-ab43f79c8776 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:47:02.135144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-043293f7-429f-48c9-84a6-ab43f79c8776 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 02 08:47:02.135144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:47:02.135144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:47:02.135144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:47:02.135144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:47:02.135144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:47:02.135144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:47:02.135144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:47:02.135144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 02 08:47:02.135144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:47:02.135144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:47:02.135144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:47:02.135144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:47:02.135144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:47:02.135144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:47:02.135144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:47:02.135144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:47:02.136368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:47:02.136368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:47:02.136368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:47:02.136368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:47:02.136368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:47:02.136368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:47:02.136368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:47:02.136368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:47:02.136368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:47:02.136368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:47:02.136368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:47:02.136368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:47:02.136368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:47:02.136368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:47:02.136368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:47:02.136368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:47:02.137619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:47:02.137619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:47:02.137619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:47:02.137619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:47:02.137619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:47:02.137619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:47:02.137619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:47:02.137619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:47:02.137619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:47:02.137619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:47:02.137619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:47:02.137619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:47:02.137619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 02 08:47:02.137619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:47:02.137619 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 445/911] 10.222.0.18 () {56 vars in 1117 bytes} [Mon May 2 08:47:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:47:02.143106 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673f184-10f3-43bf-bcf4-2959e0291e88 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:47:02.238427 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673f184-10f3-43bf-bcf4-2959e0291e88 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:47:02.271013 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38e5c6-d8a8-4b15-81ab-37c1273ea6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:47:02.271666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38e5c6-d8a8-4b15-81ab-37c1273ea6a9 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:02.271951 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38e5c6-d8a8-4b15-81ab-37c1273ea6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:02.272871 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38e5c6-d8a8-4b15-81ab-37c1273ea6a9 None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:02.273057 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38e5c6-d8a8-4b15-81ab-37c1273ea6a9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:47:02.273385 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38e5c6-d8a8-4b15-81ab-37c1273ea6a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:47:02.274789 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38e5c6-d8a8-4b15-81ab-37c1273ea6a9 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:47:02.279564 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 467/912] 10.222.0.18 () {56 vars in 1116 bytes} [Mon May 2 08:47:02 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:47:02.285756 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043293f7-429f-48c9-84a6-ab43f79c8776 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:47:02.380548 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043293f7-429f-48c9-84a6-ab43f79c8776 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:47:02.412516 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a15e39-0e80-4b8c-a53c-3645d0d45a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:47:02.413187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a15e39-0e80-4b8c-a53c-3645d0d45a6f None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:02.413471 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a15e39-0e80-4b8c-a53c-3645d0d45a6f None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:02.413748 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a15e39-0e80-4b8c-a53c-3645d0d45a6f None admin] PATH_INFO: `/v3/services` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:02.414452 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a15e39-0e80-4b8c-a53c-3645d0d45a6f None admin] RBAC: Adding query filter params (type=placement) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:47:02.414760 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a15e39-0e80-4b8c-a53c-3645d0d45a6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:47:02.416204 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a15e39-0e80-4b8c-a53c-3645d0d45a6f None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:47:02.420868 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 446/913] 10.222.0.18 () {56 vars in 1116 bytes} [Mon May 2 08:47:02 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:47:04.786936 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f55d7-aab0-4df5-91a1-8ed35bd074a3 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:04.787455 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f55d7-aab0-4df5-91a1-8ed35bd074a3 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:04.787702 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f55d7-aab0-4df5-91a1-8ed35bd074a3 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:04.789143 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 468/914] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:47:04.794263 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fba54-53b5-4a22-961b-a0059db96f36 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:04.794701 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fba54-53b5-4a22-961b-a0059db96f36 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:04.794823 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fba54-53b5-4a22-961b-a0059db96f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:04.811359 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-c56fba54-53b5-4a22-961b-a0059db96f36 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:47:04.812579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-c56fba54-53b5-4a22-961b-a0059db96f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:47:04.877047 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 447/915] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:47:04 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:47:04.901037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f55d7-aab0-4df5-91a1-8ed35bd074a3 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:47:04.998004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f55d7-aab0-4df5-91a1-8ed35bd074a3 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:47:05.030869 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a39e2-830e-463d-898b-955d3a15c62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:47:05.031519 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a39e2-830e-463d-898b-955d3a15c62c None admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:05.031797 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a39e2-830e-463d-898b-955d3a15c62c None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:05.032094 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a39e2-830e-463d-898b-955d3a15c62c None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:05.032810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a39e2-830e-463d-898b-955d3a15c62c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:47:05.034221 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a39e2-830e-463d-898b-955d3a15c62c None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:47:05.128545 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 469/916] 10.222.0.18 () {60 vars in 1141 bytes} [Mon May 2 08:47:04 2022] POST /identity/v3/services => generated 246 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 08:47:07.446573 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9aa16-2df3-474e-b671-86c1b075f602 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:07.447131 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9aa16-2df3-474e-b671-86c1b075f602 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:07.447131 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9aa16-2df3-474e-b671-86c1b075f602 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:07.448507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 448/917] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:47:07.453911 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a30d85-13ce-4c4a-96f9-7223dfca0669 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:07.454426 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a30d85-13ce-4c4a-96f9-7223dfca0669 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:07.454554 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a30d85-13ce-4c4a-96f9-7223dfca0669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:07.470757 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-c1a30d85-13ce-4c4a-96f9-7223dfca0669 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:47:07.471917 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-c1a30d85-13ce-4c4a-96f9-7223dfca0669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:47:07.539958 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 470/918] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:47:07 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 08:47:07.563716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9aa16-2df3-474e-b671-86c1b075f602 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:47:07.662265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9aa16-2df3-474e-b671-86c1b075f602 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:47:07.694970 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37907d99-eb52-4459-8765-f0d6f904b6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:47:07.696037 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37907d99-eb52-4459-8765-f0d6f904b6c7 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:07.696344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37907d99-eb52-4459-8765-f0d6f904b6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:07.696658 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37907d99-eb52-4459-8765-f0d6f904b6c7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:07.697252 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37907d99-eb52-4459-8765-f0d6f904b6c7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:47:07.698640 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37907d99-eb52-4459-8765-f0d6f904b6c7 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:47:07.710412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-37907d99-eb52-4459-8765-f0d6f904b6c7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 02 08:47:07.710412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:47:07.710412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:47:07.710412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:47:07.710412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:47:07.710412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:47:07.710412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:47:07.710412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:47:07.710412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 02 08:47:07.710412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:47:07.710412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:47:07.710412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:47:07.710412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:47:07.710412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:47:07.710412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:47:07.710412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:47:07.710412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:47:07.713542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:47:07.713542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:47:07.713542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:47:07.713542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:47:07.713542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:47:07.713542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:47:07.713542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:47:07.713542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:47:07.713542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:47:07.713542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:47:07.713542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:47:07.713542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:47:07.713542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:47:07.713542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:47:07.713542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:47:07.713542 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:47:07.714680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:47:07.714680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:47:07.714680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:47:07.714680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:47:07.714680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:47:07.714680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:47:07.714680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:47:07.714680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:47:07.714680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:47:07.714680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:47:07.714680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:47:07.714680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:47:07.714680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 02 08:47:07.714680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:47:07.714680 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 449/919] 10.222.0.18 () {56 vars in 1117 bytes} [Mon May 2 08:47:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:47:07.717621 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a30d85-13ce-4c4a-96f9-7223dfca0669 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:47:07.810753 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a30d85-13ce-4c4a-96f9-7223dfca0669 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:47:07.843417 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58a094-228d-4f1f-8701-0f41489fb3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:47:07.844099 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58a094-228d-4f1f-8701-0f41489fb3d1 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:07.844403 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58a094-228d-4f1f-8701-0f41489fb3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:07.844676 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58a094-228d-4f1f-8701-0f41489fb3d1 None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:07.845375 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58a094-228d-4f1f-8701-0f41489fb3d1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:47:07.845677 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58a094-228d-4f1f-8701-0f41489fb3d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:47:07.847024 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58a094-228d-4f1f-8701-0f41489fb3d1 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:47:07.851815 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 471/920] 10.222.0.18 () {56 vars in 1116 bytes} [Mon May 2 08:47:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:47:07.857786 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37907d99-eb52-4459-8765-f0d6f904b6c7 None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:47:07.952960 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37907d99-eb52-4459-8765-f0d6f904b6c7 None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:47:07.985627 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6d311-b3b5-4848-8f1a-577440ed8926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:47:07.986268 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6d311-b3b5-4848-8f1a-577440ed8926 None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:07.986546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6d311-b3b5-4848-8f1a-577440ed8926 None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:07.986815 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6d311-b3b5-4848-8f1a-577440ed8926 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:07.987632 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6d311-b3b5-4848-8f1a-577440ed8926 None admin] RBAC: Adding query filter params (interface=public, service_id=e67b5d893e3249038d47e35779da3de0, region_id=RegionOne) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:47:07.987973 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6d311-b3b5-4848-8f1a-577440ed8926 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:47:07.989373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6d311-b3b5-4848-8f1a-577440ed8926 None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:47:07.994189 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 450/921] 10.222.0.18 () {56 vars in 1251 bytes} [Mon May 2 08:47:07 2022] GET /identity/v3/endpoints?service_id=e67b5d893e3249038d47e35779da3de0&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:47:07.999698 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58a094-228d-4f1f-8701-0f41489fb3d1 None admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:47:08.093619 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58a094-228d-4f1f-8701-0f41489fb3d1 None admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:47:08.126374 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d1c27-acd9-489e-b4a1-9776d9d91b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:47:08.127021 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d1c27-acd9-489e-b4a1-9776d9d91b14 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:08.127300 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d1c27-acd9-489e-b4a1-9776d9d91b14 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:08.127570 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d1c27-acd9-489e-b4a1-9776d9d91b14 None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:08.128262 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d1c27-acd9-489e-b4a1-9776d9d91b14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:47:08.129627 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d1c27-acd9-489e-b4a1-9776d9d91b14 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:47:08.135848 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 472/922] 10.222.0.18 () {56 vars in 1087 bytes} [Mon May 2 08:47:07 2022] GET /identity/v3/services => generated 1962 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 08:47:10.442345 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b936da-4655-4194-91ac-7974d59b0440 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:10.442905 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b936da-4655-4194-91ac-7974d59b0440 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:10.442905 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b936da-4655-4194-91ac-7974d59b0440 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:10.444330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 451/923] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:47:10.450148 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef788c12-70aa-4083-a0fd-d54d15661041 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:10.450595 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef788c12-70aa-4083-a0fd-d54d15661041 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:10.450697 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef788c12-70aa-4083-a0fd-d54d15661041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:10.466953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-ef788c12-70aa-4083-a0fd-d54d15661041 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:47:10.468175 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-ef788c12-70aa-4083-a0fd-d54d15661041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:47:10.533578 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 473/924] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:47:10 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 08:47:10.558086 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b936da-4655-4194-91ac-7974d59b0440 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:47:10.655224 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b936da-4655-4194-91ac-7974d59b0440 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:47:10.688692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21beebe-003f-431b-8865-417d2ca3b21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:47:10.689481 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21beebe-003f-431b-8865-417d2ca3b21e None admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:10.689761 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21beebe-003f-431b-8865-417d2ca3b21e None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:10.690034 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21beebe-003f-431b-8865-417d2ca3b21e None admin] PATH_INFO: `/v3/services/placement` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:10.690719 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21beebe-003f-431b-8865-417d2ca3b21e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:47:10.692116 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21beebe-003f-431b-8865-417d2ca3b21e None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:47:10.713583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application [None req-f21beebe-003f-431b-8865-417d2ca3b21e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 02 08:47:10.713583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:47:10.713583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 08:47:10.713583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 08:47:10.713583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 08:47:10.713583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 08:47:10.713583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 08:47:10.713583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:47:10.713583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 02 08:47:10.713583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:47:10.713583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 08:47:10.713583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:47:10.713583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 08:47:10.713583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 08:47:10.713583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 08:47:10.713583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 08:47:10.713583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 08:47:10.714755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 08:47:10.714755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 08:47:10.714755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 08:47:10.714755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 08:47:10.714755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 08:47:10.714755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 08:47:10.714755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 08:47:10.714755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 08:47:10.714755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 08:47:10.714755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 08:47:10.714755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 08:47:10.714755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 08:47:10.714755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 08:47:10.714755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 08:47:10.714755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 08:47:10.714755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.get_or_create( May 02 08:47:10.715818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 08:47:10.715818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application with Lock( May 02 08:47:10.715818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 08:47:10.715818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self._enter() May 02 08:47:10.715818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 08:47:10.715818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 08:47:10.715818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 08:47:10.715818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application return self.creator() May 02 08:47:10.715818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 08:47:10.715818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application created_value = creator( May 02 08:47:10.715818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 08:47:10.715818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 08:47:10.715818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 02 08:47:10.715818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: ERROR keystone.server.flask.application May 02 08:47:10.715818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 452/925] 10.222.0.18 () {56 vars in 1117 bytes} [Mon May 2 08:47:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 08:47:10.716863 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef788c12-70aa-4083-a0fd-d54d15661041 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:47:10.806094 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef788c12-70aa-4083-a0fd-d54d15661041 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:47:10.838654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe5040-ce91-4477-a593-635c02f4f3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:47:10.839303 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe5040-ce91-4477-a593-635c02f4f3c0 None admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:10.839607 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe5040-ce91-4477-a593-635c02f4f3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:10.839966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe5040-ce91-4477-a593-635c02f4f3c0 None admin] PATH_INFO: `/v3/services` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:10.840702 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe5040-ce91-4477-a593-635c02f4f3c0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:47:10.841009 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe5040-ce91-4477-a593-635c02f4f3c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:47:10.842373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe5040-ce91-4477-a593-635c02f4f3c0 None admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:47:10.847804 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 474/926] 10.222.0.18 () {56 vars in 1116 bytes} [Mon May 2 08:47:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:47:10.853710 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21beebe-003f-431b-8865-417d2ca3b21e None admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:47:10.947763 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21beebe-003f-431b-8865-417d2ca3b21e None admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:47:10.979911 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61912d-a5a2-4cad-a9b6-9e15ce8a43ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:47:10.980525 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61912d-a5a2-4cad-a9b6-9e15ce8a43ba None admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:47:10.980813 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61912d-a5a2-4cad-a9b6-9e15ce8a43ba None admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:47:10.981130 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61912d-a5a2-4cad-a9b6-9e15ce8a43ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:47:10.981839 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61912d-a5a2-4cad-a9b6-9e15ce8a43ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:47:10.983199 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61912d-a5a2-4cad-a9b6-9e15ce8a43ba None admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:47:11.056411 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 453/927] 10.222.0.18 () {60 vars in 1144 bytes} [Mon May 2 08:47:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:52:57.514747 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0d25d-8d2b-4ccd-b886-7b09cc1ee92d None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:52:57.515297 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0d25d-8d2b-4ccd-b886-7b09cc1ee92d None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:52:57.515297 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0d25d-8d2b-4ccd-b886-7b09cc1ee92d None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:52:57.516800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 475/928] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:52:57.523964 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f282-e306-4086-b2c1-9e3a5b34e92b None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:52:57.523964 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f282-e306-4086-b2c1-9e3a5b34e92b None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:52:57.524589 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f282-e306-4086-b2c1-9e3a5b34e92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:52:57.543457 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-2af8f282-e306-4086-b2c1-9e3a5b34e92b None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:52:57.544728 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-2af8f282-e306-4086-b2c1-9e3a5b34e92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:52:57.628558 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 454/929] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:52:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:52:57.675849 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd324103-7cbb-4570-8beb-089150405b8e None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:52:57.676190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd324103-7cbb-4570-8beb-089150405b8e None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:52:57.676475 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd324103-7cbb-4570-8beb-089150405b8e None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:52:57.678140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 476/930] 10.222.0.18 () {54 vars in 964 bytes} [Mon May 2 08:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:52:57.684895 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d5e46-2a6b-408b-81a6-db3742cf074c None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:52:57.685408 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d5e46-2a6b-408b-81a6-db3742cf074c None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:52:57.685856 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d5e46-2a6b-408b-81a6-db3742cf074c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:52:57.750132 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-896d5e46-2a6b-408b-81a6-db3742cf074c None None] MFA Rules not processed for user `31e2b07c860d4316b35b1656f2f1c1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:52:57.752006 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-896d5e46-2a6b-408b-81a6-db3742cf074c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:52:57.823332 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 455/931] 10.222.0.18 () {58 vars in 1061 bytes} [Mon May 2 08:52:57 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:52:57.832378 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd324103-7cbb-4570-8beb-089150405b8e None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:52:57.844119 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd324103-7cbb-4570-8beb-089150405b8e None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:52:57.847659 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5083994-4f37-4745-90ea-d2fcb62a60de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:52:57.848331 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5083994-4f37-4745-90ea-d2fcb62a60de service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:52:57.848612 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5083994-4f37-4745-90ea-d2fcb62a60de service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:52:57.848884 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5083994-4f37-4745-90ea-d2fcb62a60de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:52:57.858096 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5083994-4f37-4745-90ea-d2fcb62a60de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:52:57.859509 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5083994-4f37-4745-90ea-d2fcb62a60de service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:52:57.869501 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 477/932] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:52:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:53:00.458572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7a0da-e53f-4b82-bf08-bcf70079b41b None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:00.459105 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7a0da-e53f-4b82-bf08-bcf70079b41b None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:00.459105 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7a0da-e53f-4b82-bf08-bcf70079b41b None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:00.460541 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 456/933] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:00.465693 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038255f-b895-4a39-adc4-abd8ef1def47 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:00.466114 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038255f-b895-4a39-adc4-abd8ef1def47 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:00.466257 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038255f-b895-4a39-adc4-abd8ef1def47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:00.494140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-d038255f-b895-4a39-adc4-abd8ef1def47 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:00.495373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-d038255f-b895-4a39-adc4-abd8ef1def47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:00.503718 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 478/934] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:53:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:53:00.542986 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7a0da-e53f-4b82-bf08-bcf70079b41b None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:53:00.553375 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7a0da-e53f-4b82-bf08-bcf70079b41b None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:53:00.557731 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32613e-83e2-4c5a-8b6a-e72d01f36057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:53:00.558367 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32613e-83e2-4c5a-8b6a-e72d01f36057 service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:00.558652 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32613e-83e2-4c5a-8b6a-e72d01f36057 service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:00.558927 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32613e-83e2-4c5a-8b6a-e72d01f36057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:00.567991 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32613e-83e2-4c5a-8b6a-e72d01f36057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:53:00.569455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32613e-83e2-4c5a-8b6a-e72d01f36057 service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:53:00.578755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 457/935] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:53:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:53:03.485937 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f175b-5d6a-42de-9ab6-a6ec038d8f10 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:03.486474 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f175b-5d6a-42de-9ab6-a6ec038d8f10 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:03.486474 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f175b-5d6a-42de-9ab6-a6ec038d8f10 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:03.487849 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 479/936] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:03.493414 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d22f90-2e77-4dd0-9c59-933873997b4f None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:03.493867 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d22f90-2e77-4dd0-9c59-933873997b4f None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:03.493965 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d22f90-2e77-4dd0-9c59-933873997b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:03.529294 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-21d22f90-2e77-4dd0-9c59-933873997b4f None None] MFA Rules not processed for user `e1895d390d79461cb033f7ffd725f75e`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:03.530477 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-21d22f90-2e77-4dd0-9c59-933873997b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:03.608528 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 458/937] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:53:03 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:53:03.648861 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f175b-5d6a-42de-9ab6-a6ec038d8f10 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:53:03.659560 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f175b-5d6a-42de-9ab6-a6ec038d8f10 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:53:03.662842 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1cbd3-703a-4586-823c-ce2a0524207d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:53:03.663694 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1cbd3-703a-4586-823c-ce2a0524207d service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:03.664169 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1cbd3-703a-4586-823c-ce2a0524207d service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:03.664455 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1cbd3-703a-4586-823c-ce2a0524207d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:03.673298 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1cbd3-703a-4586-823c-ce2a0524207d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:53:03.675163 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1cbd3-703a-4586-823c-ce2a0524207d service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:53:03.685215 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 480/938] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:53:03 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:53:06.804957 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9658c4-9ef3-4a2d-8da1-a82a92ff5226 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:06.805509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9658c4-9ef3-4a2d-8da1-a82a92ff5226 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:06.805509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9658c4-9ef3-4a2d-8da1-a82a92ff5226 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:06.806845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 459/939] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:06.812212 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a300228-206e-4776-8a9c-dd89d2ec3db0 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:06.812655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a300228-206e-4776-8a9c-dd89d2ec3db0 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:06.813014 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a300228-206e-4776-8a9c-dd89d2ec3db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:06.869645 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-1a300228-206e-4776-8a9c-dd89d2ec3db0 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:06.870835 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-1a300228-206e-4776-8a9c-dd89d2ec3db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:06.954530 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 481/940] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:53:06 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:53:06.993807 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9658c4-9ef3-4a2d-8da1-a82a92ff5226 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:53:07.003943 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9658c4-9ef3-4a2d-8da1-a82a92ff5226 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:53:07.008103 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552b02a-d478-4512-8ab3-3e96a45745d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:53:07.008729 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552b02a-d478-4512-8ab3-3e96a45745d0 service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:07.009008 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552b02a-d478-4512-8ab3-3e96a45745d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:07.009277 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552b02a-d478-4512-8ab3-3e96a45745d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:07.017747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552b02a-d478-4512-8ab3-3e96a45745d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:53:07.019171 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552b02a-d478-4512-8ab3-3e96a45745d0 service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:53:07.028495 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 460/941] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:53:06 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:53:10.371761 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0438a-b0d6-42f7-815c-126ec435d561 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:10.372361 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0438a-b0d6-42f7-815c-126ec435d561 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:10.372361 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0438a-b0d6-42f7-815c-126ec435d561 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:10.373702 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 482/942] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:10.379050 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6988af-4057-4054-ad66-c03a8610d532 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:10.379464 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6988af-4057-4054-ad66-c03a8610d532 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:10.379608 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6988af-4057-4054-ad66-c03a8610d532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:10.406964 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-1a6988af-4057-4054-ad66-c03a8610d532 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:10.408171 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-1a6988af-4057-4054-ad66-c03a8610d532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:10.424903 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 461/943] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:53:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:53:10.462398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0438a-b0d6-42f7-815c-126ec435d561 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:53:10.472792 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0438a-b0d6-42f7-815c-126ec435d561 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:53:10.476514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fa865-7f4b-46cc-b79f-513c066d6fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:53:10.477142 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fa865-7f4b-46cc-b79f-513c066d6fdd service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:10.477426 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fa865-7f4b-46cc-b79f-513c066d6fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:10.477702 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fa865-7f4b-46cc-b79f-513c066d6fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:10.486294 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fa865-7f4b-46cc-b79f-513c066d6fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:53:10.487723 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fa865-7f4b-46cc-b79f-513c066d6fdd service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:53:10.497583 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 483/944] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:53:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:53:12.847577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378688f-9a77-4ec0-b3a0-04db99fd1460 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:12.848102 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378688f-9a77-4ec0-b3a0-04db99fd1460 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:12.848102 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378688f-9a77-4ec0-b3a0-04db99fd1460 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:12.849417 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 462/945] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:12.854815 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2b9b1-4540-45a8-8121-f26c46108fe2 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:12.855249 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2b9b1-4540-45a8-8121-f26c46108fe2 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:12.855385 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2b9b1-4540-45a8-8121-f26c46108fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:12.873276 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-e1e2b9b1-4540-45a8-8121-f26c46108fe2 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:12.874445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-e1e2b9b1-4540-45a8-8121-f26c46108fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:12.882594 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 484/946] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:53:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:53:12.917824 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378688f-9a77-4ec0-b3a0-04db99fd1460 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:53:12.928100 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378688f-9a77-4ec0-b3a0-04db99fd1460 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:53:12.932030 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1ab0d-67ad-4a98-9392-98cecad4655b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:53:12.932716 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1ab0d-67ad-4a98-9392-98cecad4655b service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:12.933000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1ab0d-67ad-4a98-9392-98cecad4655b service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:12.933277 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1ab0d-67ad-4a98-9392-98cecad4655b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:12.942357 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1ab0d-67ad-4a98-9392-98cecad4655b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:53:12.943806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1ab0d-67ad-4a98-9392-98cecad4655b service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:53:12.953641 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 463/947] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:53:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:53:15.299334 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95068ca4-e890-472d-8656-68819d557005 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:15.299917 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95068ca4-e890-472d-8656-68819d557005 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:15.299917 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95068ca4-e890-472d-8656-68819d557005 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:15.301226 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 485/948] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:15.306683 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc0ce6-49b9-4df0-9754-fb35f0026273 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:15.307142 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc0ce6-49b9-4df0-9754-fb35f0026273 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:15.307246 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc0ce6-49b9-4df0-9754-fb35f0026273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:15.325402 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-6ccc0ce6-49b9-4df0-9754-fb35f0026273 None None] MFA Rules not processed for user `e1895d390d79461cb033f7ffd725f75e`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:15.326577 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-6ccc0ce6-49b9-4df0-9754-fb35f0026273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:15.334360 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 464/949] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:53:15 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:53:15.388490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e8163-390c-4530-94bc-1d55c1c0866e None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:15.388865 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e8163-390c-4530-94bc-1d55c1c0866e None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:15.389211 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e8163-390c-4530-94bc-1d55c1c0866e None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:15.390647 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 486/950] 10.222.0.18 () {54 vars in 964 bytes} [Mon May 2 08:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:15.396693 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e65cb6-ab11-4bc4-aed5-3f5e3e20157c None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:15.396983 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e65cb6-ab11-4bc4-aed5-3f5e3e20157c None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:15.397955 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e65cb6-ab11-4bc4-aed5-3f5e3e20157c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:15.415802 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-f6e65cb6-ab11-4bc4-aed5-3f5e3e20157c None None] MFA Rules not processed for user `31e2b07c860d4316b35b1656f2f1c1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:15.417013 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-f6e65cb6-ab11-4bc4-aed5-3f5e3e20157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:15.429392 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 465/951] 10.222.0.18 () {58 vars in 1061 bytes} [Mon May 2 08:53:15 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 08:53:15.438365 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e8163-390c-4530-94bc-1d55c1c0866e None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:53:15.449445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e8163-390c-4530-94bc-1d55c1c0866e None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:53:15.452914 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34a0ea-be8d-4a56-aec6-33f0f03ca943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:53:15.453544 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34a0ea-be8d-4a56-aec6-33f0f03ca943 service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:15.453824 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34a0ea-be8d-4a56-aec6-33f0f03ca943 service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:15.454096 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34a0ea-be8d-4a56-aec6-33f0f03ca943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:15.463710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34a0ea-be8d-4a56-aec6-33f0f03ca943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:53:15.465175 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34a0ea-be8d-4a56-aec6-33f0f03ca943 service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:53:15.474714 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 487/952] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:53:15 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:53:18.595545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15b4bb-e652-4261-ba87-df8c42c87174 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:18.596111 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15b4bb-e652-4261-ba87-df8c42c87174 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:18.596111 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15b4bb-e652-4261-ba87-df8c42c87174 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:18.597470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 466/953] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:18.602951 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8d672-76c6-4b34-8408-e3053136c8c0 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:18.603380 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8d672-76c6-4b34-8408-e3053136c8c0 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:18.603642 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8d672-76c6-4b34-8408-e3053136c8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:18.620817 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-e4c8d672-76c6-4b34-8408-e3053136c8c0 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:18.622033 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-e4c8d672-76c6-4b34-8408-e3053136c8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:18.630075 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 488/954] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:53:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:53:18.666985 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15b4bb-e652-4261-ba87-df8c42c87174 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:53:18.677314 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15b4bb-e652-4261-ba87-df8c42c87174 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:53:18.681351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6751a-69ad-45cc-a11f-44ed1ea28ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:53:18.681981 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6751a-69ad-45cc-a11f-44ed1ea28ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:18.682259 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6751a-69ad-45cc-a11f-44ed1ea28ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:18.682531 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6751a-69ad-45cc-a11f-44ed1ea28ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:18.691613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6751a-69ad-45cc-a11f-44ed1ea28ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:53:18.693077 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6751a-69ad-45cc-a11f-44ed1ea28ca0 service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:53:18.703574 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 467/955] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:53:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:53:21.042445 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c32555-51dd-42c7-9b47-05fea37b0e26 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:21.043451 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c32555-51dd-42c7-9b47-05fea37b0e26 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:21.044353 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c32555-51dd-42c7-9b47-05fea37b0e26 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:21.045478 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 489/956] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:53:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:21.051023 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b607679-4701-45c4-acc7-7caab75dd5b1 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:21.051784 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b607679-4701-45c4-acc7-7caab75dd5b1 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:21.052092 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b607679-4701-45c4-acc7-7caab75dd5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:21.070575 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-5b607679-4701-45c4-acc7-7caab75dd5b1 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:21.071765 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-5b607679-4701-45c4-acc7-7caab75dd5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:21.079501 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 468/957] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:53:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:53:21.119887 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c32555-51dd-42c7-9b47-05fea37b0e26 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:53:21.130815 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c32555-51dd-42c7-9b47-05fea37b0e26 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:53:21.134387 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76012198-ceca-483e-b911-7ea5cbc92bf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:53:21.135300 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76012198-ceca-483e-b911-7ea5cbc92bf1 service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:21.135576 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76012198-ceca-483e-b911-7ea5cbc92bf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:21.135845 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76012198-ceca-483e-b911-7ea5cbc92bf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:21.144798 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76012198-ceca-483e-b911-7ea5cbc92bf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:53:21.146229 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76012198-ceca-483e-b911-7ea5cbc92bf1 service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:53:21.155972 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 490/958] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:53:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:53:24.242998 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccada5-c2da-4d4d-bbd5-b1dc01870e28 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:24.243533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccada5-c2da-4d4d-bbd5-b1dc01870e28 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:24.243533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccada5-c2da-4d4d-bbd5-b1dc01870e28 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:24.244915 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 469/959] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:24.250103 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ffcd5-0ad9-41aa-9926-8ea734a74513 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:24.250507 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ffcd5-0ad9-41aa-9926-8ea734a74513 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:24.250665 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ffcd5-0ad9-41aa-9926-8ea734a74513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:24.283018 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-e07ffcd5-0ad9-41aa-9926-8ea734a74513 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:24.284254 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-e07ffcd5-0ad9-41aa-9926-8ea734a74513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:24.301743 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 491/960] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:53:24 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:53:24.337822 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccada5-c2da-4d4d-bbd5-b1dc01870e28 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:53:24.348165 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccada5-c2da-4d4d-bbd5-b1dc01870e28 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:53:24.352342 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2d8aa-2417-490d-b62a-50be695ba909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:53:24.353880 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2d8aa-2417-490d-b62a-50be695ba909 service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:24.353880 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2d8aa-2417-490d-b62a-50be695ba909 service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:24.353880 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2d8aa-2417-490d-b62a-50be695ba909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:24.362000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2d8aa-2417-490d-b62a-50be695ba909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:53:24.363426 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2d8aa-2417-490d-b62a-50be695ba909 service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:53:24.373279 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 470/961] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:53:24 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:53:28.985065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42b41b-1ac4-428e-8d6b-e245ff96777f None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:28.985589 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42b41b-1ac4-428e-8d6b-e245ff96777f None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:28.985667 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42b41b-1ac4-428e-8d6b-e245ff96777f None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:28.986970 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 492/962] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:28.992756 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca1596-b964-44ed-8e83-045d6089830d None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:28.993200 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca1596-b964-44ed-8e83-045d6089830d None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:28.993300 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca1596-b964-44ed-8e83-045d6089830d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:29.011837 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-4cca1596-b964-44ed-8e83-045d6089830d None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:29.013082 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-4cca1596-b964-44ed-8e83-045d6089830d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:29.021720 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 471/963] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:53:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 08:53:29.062671 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42b41b-1ac4-428e-8d6b-e245ff96777f None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:53:29.073825 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42b41b-1ac4-428e-8d6b-e245ff96777f None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:53:29.077386 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d1d30-d409-4aaa-b599-12a274c41716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:53:29.078020 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d1d30-d409-4aaa-b599-12a274c41716 service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:29.078301 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d1d30-d409-4aaa-b599-12a274c41716 service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:29.078579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d1d30-d409-4aaa-b599-12a274c41716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:29.087887 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d1d30-d409-4aaa-b599-12a274c41716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:53:29.089295 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d1d30-d409-4aaa-b599-12a274c41716 service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:53:29.098590 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 493/964] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:53:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:53:32.411691 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c607e9-8812-41b6-ab32-3278b3af541c None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:32.412498 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c607e9-8812-41b6-ab32-3278b3af541c None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:32.412498 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c607e9-8812-41b6-ab32-3278b3af541c None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:32.414851 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 472/965] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:32.419896 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5218d23-e5e4-4b53-91b1-c73eeefcac92 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:32.420348 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5218d23-e5e4-4b53-91b1-c73eeefcac92 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:32.420642 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5218d23-e5e4-4b53-91b1-c73eeefcac92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:32.438361 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-b5218d23-e5e4-4b53-91b1-c73eeefcac92 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:32.439527 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-b5218d23-e5e4-4b53-91b1-c73eeefcac92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:32.447556 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 494/966] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:53:32 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:53:32.486687 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c607e9-8812-41b6-ab32-3278b3af541c None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:53:32.497844 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c607e9-8812-41b6-ab32-3278b3af541c None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:53:32.501363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f7e5f-0831-421e-8c69-d30a737bba8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:53:32.502000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f7e5f-0831-421e-8c69-d30a737bba8f service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:32.502277 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f7e5f-0831-421e-8c69-d30a737bba8f service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:32.502548 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f7e5f-0831-421e-8c69-d30a737bba8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:32.512278 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f7e5f-0831-421e-8c69-d30a737bba8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:53:32.513731 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f7e5f-0831-421e-8c69-d30a737bba8f service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:53:32.523187 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 473/967] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:53:32 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:53:37.294685 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1aef5-2d59-4249-8d79-76a96cb7978e None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:37.295195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1aef5-2d59-4249-8d79-76a96cb7978e None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:37.295195 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1aef5-2d59-4249-8d79-76a96cb7978e None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:37.296690 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 495/968] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:37.301582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae61449-38ed-46f3-af98-b680577ca1bf None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:37.301971 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae61449-38ed-46f3-af98-b680577ca1bf None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:37.302273 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae61449-38ed-46f3-af98-b680577ca1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:37.320691 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-bae61449-38ed-46f3-af98-b680577ca1bf None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:37.321858 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-bae61449-38ed-46f3-af98-b680577ca1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:37.329456 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 474/969] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:53:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 08:53:37.368337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1aef5-2d59-4249-8d79-76a96cb7978e None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:53:37.378569 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1aef5-2d59-4249-8d79-76a96cb7978e None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:53:37.382089 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136939ae-527e-4ccd-bc99-9129ecf97367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:53:37.382709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136939ae-527e-4ccd-bc99-9129ecf97367 service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:37.382988 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136939ae-527e-4ccd-bc99-9129ecf97367 service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:37.383260 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136939ae-527e-4ccd-bc99-9129ecf97367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:37.391840 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136939ae-527e-4ccd-bc99-9129ecf97367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:53:37.393283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136939ae-527e-4ccd-bc99-9129ecf97367 service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:53:37.403045 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 496/970] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:53:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:53:42.804191 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e952a-b086-4ea3-9326-ef749c7c0d57 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:42.804703 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e952a-b086-4ea3-9326-ef749c7c0d57 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:42.804978 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e952a-b086-4ea3-9326-ef749c7c0d57 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:42.806704 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 475/971] 10.222.0.18 () {54 vars in 921 bytes} [Mon May 2 08:53:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:42.811562 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d70870-5f9c-4b51-ab54-5f5218633345 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:42.812304 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d70870-5f9c-4b51-ab54-5f5218633345 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:42.812413 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d70870-5f9c-4b51-ab54-5f5218633345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:42.866529 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-b1d70870-5f9c-4b51-ab54-5f5218633345 None None] MFA Rules not processed for user `894ff70da3bb45ce858b2d34224eab93`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:42.867868 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-b1d70870-5f9c-4b51-ab54-5f5218633345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:42.967459 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 497/972] 10.222.0.18 () {58 vars in 1018 bytes} [Mon May 2 08:53:42 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:53:47.439126 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c58840-a931-4d37-ab6c-ef131a55043b None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:47.439723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c58840-a931-4d37-ab6c-ef131a55043b None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:47.439723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c58840-a931-4d37-ab6c-ef131a55043b None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:47.441338 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 476/973] 10.222.0.18 () {54 vars in 921 bytes} [Mon May 2 08:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:47.447332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70961f96-1462-4b27-a007-99b04b3e0552 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:47.448383 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70961f96-1462-4b27-a007-99b04b3e0552 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:47.448932 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70961f96-1462-4b27-a007-99b04b3e0552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:47.468159 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-70961f96-1462-4b27-a007-99b04b3e0552 None None] MFA Rules not processed for user `894ff70da3bb45ce858b2d34224eab93`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:47.469713 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-70961f96-1462-4b27-a007-99b04b3e0552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:47.480522 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 498/974] 10.222.0.18 () {58 vars in 1018 bytes} [Mon May 2 08:53:47 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:53:48.992676 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3091e-c666-4a7b-aaf4-8660b31d0a40 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:48.993228 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3091e-c666-4a7b-aaf4-8660b31d0a40 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:48.993333 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3091e-c666-4a7b-aaf4-8660b31d0a40 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:48.994707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 477/975] 10.222.0.18 () {54 vars in 921 bytes} [Mon May 2 08:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:48.999820 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c4c13-da7e-4134-8a0e-5845130fefa4 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:49.000282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c4c13-da7e-4134-8a0e-5845130fefa4 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:49.000400 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c4c13-da7e-4134-8a0e-5845130fefa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:49.018908 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-1e5c4c13-da7e-4134-8a0e-5845130fefa4 None None] MFA Rules not processed for user `894ff70da3bb45ce858b2d34224eab93`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:49.020090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-1e5c4c13-da7e-4134-8a0e-5845130fefa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:49.028929 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 499/976] 10.222.0.18 () {58 vars in 1018 bytes} [Mon May 2 08:53:48 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 08:53:52.967975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82879ba6-e09d-4f3e-bcb7-d6675d4dc977 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:52.968530 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82879ba6-e09d-4f3e-bcb7-d6675d4dc977 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:52.968612 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82879ba6-e09d-4f3e-bcb7-d6675d4dc977 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:52.969982 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 478/977] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:52.975793 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8eae5-ae91-44ce-8ef3-d84a320136e6 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:52.976269 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8eae5-ae91-44ce-8ef3-d84a320136e6 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:52.976455 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8eae5-ae91-44ce-8ef3-d84a320136e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:52.993973 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-dcf8eae5-ae91-44ce-8ef3-d84a320136e6 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:52.995145 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-dcf8eae5-ae91-44ce-8ef3-d84a320136e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:53.003021 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 500/978] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:53:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:53:53.053937 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9707c8-bc99-4ecd-a140-d63dcd4a6e77 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:53.054549 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9707c8-bc99-4ecd-a140-d63dcd4a6e77 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:53.055017 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9707c8-bc99-4ecd-a140-d63dcd4a6e77 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:53.057019 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 479/979] 10.222.0.18 () {54 vars in 960 bytes} [Mon May 2 08:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:53:53.063141 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44108291-ec84-4367-af27-a3736df76614 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:53.063660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44108291-ec84-4367-af27-a3736df76614 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:53.064027 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44108291-ec84-4367-af27-a3736df76614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:53.101910 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-44108291-ec84-4367-af27-a3736df76614 None None] MFA Rules not processed for user `97308967556844019594cd0c4abc41fc`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:53.103088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-44108291-ec84-4367-af27-a3736df76614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:53.172096 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 501/980] 10.222.0.18 () {58 vars in 1057 bytes} [Mon May 2 08:53:53 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 08:53:53.180427 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9707c8-bc99-4ecd-a140-d63dcd4a6e77 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:53:53.194161 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9707c8-bc99-4ecd-a140-d63dcd4a6e77 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:53:53.199442 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318c210-400e-4446-8a69-5e2b0a12f15b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:53:53.200124 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318c210-400e-4446-8a69-5e2b0a12f15b service nova] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:53.200412 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318c210-400e-4446-8a69-5e2b0a12f15b service nova] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:53.200703 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318c210-400e-4446-8a69-5e2b0a12f15b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:53.209293 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318c210-400e-4446-8a69-5e2b0a12f15b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:53:53.210901 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318c210-400e-4446-8a69-5e2b0a12f15b service nova] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:53:53.220498 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 480/981] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:53:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:53:55.744197 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3636f4-6d38-45c0-aee4-e6fcb26e47c9 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:55.744775 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3636f4-6d38-45c0-aee4-e6fcb26e47c9 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:55.744775 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3636f4-6d38-45c0-aee4-e6fcb26e47c9 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:55.746269 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 502/982] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:55.751315 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6740b8-039e-49e8-847f-812a8961ad4b None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:55.751706 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6740b8-039e-49e8-847f-812a8961ad4b None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:55.751875 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6740b8-039e-49e8-847f-812a8961ad4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:55.770745 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-ae6740b8-039e-49e8-847f-812a8961ad4b None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:55.772243 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-ae6740b8-039e-49e8-847f-812a8961ad4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:55.780843 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 481/983] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:53:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:53:55.827506 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3636f4-6d38-45c0-aee4-e6fcb26e47c9 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:53:55.842028 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3636f4-6d38-45c0-aee4-e6fcb26e47c9 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:53:55.847274 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858f46e-c978-4e26-9c45-1b6c0cb7e8bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:53:55.847917 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858f46e-c978-4e26-9c45-1b6c0cb7e8bc service nova] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:55.848245 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858f46e-c978-4e26-9c45-1b6c0cb7e8bc service nova] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:55.848623 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858f46e-c978-4e26-9c45-1b6c0cb7e8bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:55.857081 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858f46e-c978-4e26-9c45-1b6c0cb7e8bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:53:55.858653 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858f46e-c978-4e26-9c45-1b6c0cb7e8bc service nova] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:53:55.868187 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 503/984] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:53:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:53:58.593119 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da595d10-3d74-492a-bf5e-70808a2500d8 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:58.593611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da595d10-3d74-492a-bf5e-70808a2500d8 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:58.593611 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da595d10-3d74-492a-bf5e-70808a2500d8 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:58.594944 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 482/985] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:58.600598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cd647-5aa7-454e-9bcd-b1939143d869 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:58.600997 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cd647-5aa7-454e-9bcd-b1939143d869 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:58.601154 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cd647-5aa7-454e-9bcd-b1939143d869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:58.619304 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-a98cd647-5aa7-454e-9bcd-b1939143d869 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:58.620515 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-a98cd647-5aa7-454e-9bcd-b1939143d869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:58.628388 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 504/986] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:53:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 08:53:58.674913 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f62e-a1b2-4c63-b6c1-207c15355ae6 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:58.675293 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f62e-a1b2-4c63-b6c1-207c15355ae6 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:58.675636 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f62e-a1b2-4c63-b6c1-207c15355ae6 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:58.677964 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 483/987] 10.222.0.18 () {54 vars in 960 bytes} [Mon May 2 08:53:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:53:58.683026 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a0141-76fd-4d2e-bce7-45ad1fe4c576 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:58.683511 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a0141-76fd-4d2e-bce7-45ad1fe4c576 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:58.683792 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a0141-76fd-4d2e-bce7-45ad1fe4c576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:58.702213 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-565a0141-76fd-4d2e-bce7-45ad1fe4c576 None None] MFA Rules not processed for user `97308967556844019594cd0c4abc41fc`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:53:58.703371 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-565a0141-76fd-4d2e-bce7-45ad1fe4c576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:53:58.712651 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 505/988] 10.222.0.18 () {58 vars in 1057 bytes} [Mon May 2 08:53:58 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 08:53:58.719996 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618f62e-a1b2-4c63-b6c1-207c15355ae6 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:53:58.733625 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618f62e-a1b2-4c63-b6c1-207c15355ae6 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:53:58.738323 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a68a4b-d37a-4bd7-b229-5988036b3021 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:53:58.738962 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a68a4b-d37a-4bd7-b229-5988036b3021 service nova] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:53:58.739265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a68a4b-d37a-4bd7-b229-5988036b3021 service nova] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:53:58.739530 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a68a4b-d37a-4bd7-b229-5988036b3021 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:53:58.747279 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a68a4b-d37a-4bd7-b229-5988036b3021 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:53:58.748880 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a68a4b-d37a-4bd7-b229-5988036b3021 service nova] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:53:58.758478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 484/989] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:53:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:01.432948 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ea9cd-a82f-4e7e-8499-1d276cc73c57 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:01.434004 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ea9cd-a82f-4e7e-8499-1d276cc73c57 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:01.434528 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ea9cd-a82f-4e7e-8499-1d276cc73c57 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:01.436665 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 506/990] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:54:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:01.444148 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e80f94-b5ad-4fd0-9abf-95b46406c048 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:01.445078 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e80f94-b5ad-4fd0-9abf-95b46406c048 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:01.445584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e80f94-b5ad-4fd0-9abf-95b46406c048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:01.466419 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-d3e80f94-b5ad-4fd0-9abf-95b46406c048 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:01.468227 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-d3e80f94-b5ad-4fd0-9abf-95b46406c048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:01.483630 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 485/991] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:54:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:01.528514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ea9cd-a82f-4e7e-8499-1d276cc73c57 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:01.544359 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ea9cd-a82f-4e7e-8499-1d276cc73c57 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:01.549603 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40a927-3c88-4d47-8a2c-2fccbad38fc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:01.550453 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40a927-3c88-4d47-8a2c-2fccbad38fc7 service nova] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:01.550916 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40a927-3c88-4d47-8a2c-2fccbad38fc7 service nova] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:01.551910 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40a927-3c88-4d47-8a2c-2fccbad38fc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:01.561137 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40a927-3c88-4d47-8a2c-2fccbad38fc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:01.563253 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40a927-3c88-4d47-8a2c-2fccbad38fc7 service nova] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:01.586032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 507/992] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:03.031380 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d5cbb-e9a2-4924-8d3e-302aae7949f8 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:03.031905 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d5cbb-e9a2-4924-8d3e-302aae7949f8 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:03.031905 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d5cbb-e9a2-4924-8d3e-302aae7949f8 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:03.039442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54aeb-e067-4a60-a720-2c1b7aaba4f0 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:03.040014 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54aeb-e067-4a60-a720-2c1b7aaba4f0 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:03.040014 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54aeb-e067-4a60-a720-2c1b7aaba4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:03.041962 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 486/993] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:03.059742 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-d6a54aeb-e067-4a60-a720-2c1b7aaba4f0 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:03.061163 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-d6a54aeb-e067-4a60-a720-2c1b7aaba4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:03.080279 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 508/994] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:54:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:03.392600 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56b71b-f694-4555-82f0-d9adb09bdd8d None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:03.392600 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56b71b-f694-4555-82f0-d9adb09bdd8d None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:03.392600 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56b71b-f694-4555-82f0-d9adb09bdd8d None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:03.392600 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 487/995] 10.222.0.18 () {54 vars in 963 bytes} [Mon May 2 08:54:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:03.397877 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91dd21-d4e0-4abc-b232-8f9456b5f59f None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:03.398254 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91dd21-d4e0-4abc-b232-8f9456b5f59f None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:03.398608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91dd21-d4e0-4abc-b232-8f9456b5f59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:03.434719 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-cc91dd21-d4e0-4abc-b232-8f9456b5f59f None None] MFA Rules not processed for user `351c1af1091f4f97962da2c5e2d330d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:03.435893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-cc91dd21-d4e0-4abc-b232-8f9456b5f59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:03.497069 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 509/996] 10.222.0.18 () {58 vars in 1060 bytes} [Mon May 2 08:54:03 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 08:54:03.505311 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56b71b-f694-4555-82f0-d9adb09bdd8d None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:03.516964 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56b71b-f694-4555-82f0-d9adb09bdd8d None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:03.521397 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899224f4-1c40-4b5b-b924-4dff1b088d72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351c1af1091f4f97962da2c5e2d330d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:03.522050 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899224f4-1c40-4b5b-b924-4dff1b088d72 service cinder] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:03.522330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899224f4-1c40-4b5b-b924-4dff1b088d72 service cinder] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:03.522598 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899224f4-1c40-4b5b-b924-4dff1b088d72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:03.531613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899224f4-1c40-4b5b-b924-4dff1b088d72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:03.533095 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899224f4-1c40-4b5b-b924-4dff1b088d72 service cinder] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:03.542907 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 488/997] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:04.290525 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11469a62-8d0e-438f-9905-6f5c6fb2099d None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:04.291040 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11469a62-8d0e-438f-9905-6f5c6fb2099d None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:04.291040 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11469a62-8d0e-438f-9905-6f5c6fb2099d None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:04.292423 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 510/998] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:04.297875 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cad55b-26cd-43d3-9101-6c7034fa6a66 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:04.298339 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cad55b-26cd-43d3-9101-6c7034fa6a66 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:04.298438 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cad55b-26cd-43d3-9101-6c7034fa6a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:04.318653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-12cad55b-26cd-43d3-9101-6c7034fa6a66 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:04.319861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-12cad55b-26cd-43d3-9101-6c7034fa6a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:04.328020 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 489/999] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:54:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:04.374748 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11469a62-8d0e-438f-9905-6f5c6fb2099d None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:04.393065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11469a62-8d0e-438f-9905-6f5c6fb2099d None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:04.402114 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18db11-d3b3-4017-af40-95baa9082079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:04.402114 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18db11-d3b3-4017-af40-95baa9082079 service nova] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:04.402114 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18db11-d3b3-4017-af40-95baa9082079 service nova] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:04.402541 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18db11-d3b3-4017-af40-95baa9082079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:04.413845 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18db11-d3b3-4017-af40-95baa9082079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:04.415648 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18db11-d3b3-4017-af40-95baa9082079 service nova] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:04.425582 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 511/1000] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:06.997698 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38449e08-520b-4fbe-8729-f98679fe05a6 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:06.998196 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38449e08-520b-4fbe-8729-f98679fe05a6 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:06.998293 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38449e08-520b-4fbe-8729-f98679fe05a6 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:06.999597 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 490/1001] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:07.004973 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823be265-1f9b-41ef-b162-3f0c1a3b0111 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:07.005397 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823be265-1f9b-41ef-b162-3f0c1a3b0111 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:07.005493 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823be265-1f9b-41ef-b162-3f0c1a3b0111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:07.022832 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-823be265-1f9b-41ef-b162-3f0c1a3b0111 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:07.024006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-823be265-1f9b-41ef-b162-3f0c1a3b0111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:07.031713 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 512/1002] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:54:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:07.078346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38449e08-520b-4fbe-8729-f98679fe05a6 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:07.091398 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38449e08-520b-4fbe-8729-f98679fe05a6 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:07.096356 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e4aff-6722-4a52-a437-5784fa98d838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:07.096994 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e4aff-6722-4a52-a437-5784fa98d838 service nova] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:07.097280 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e4aff-6722-4a52-a437-5784fa98d838 service nova] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:07.097555 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e4aff-6722-4a52-a437-5784fa98d838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:07.106124 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e4aff-6722-4a52-a437-5784fa98d838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:07.107723 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e4aff-6722-4a52-a437-5784fa98d838 service nova] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:07.117666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 491/1003] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:09.622234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1305a-ebb4-4528-a48c-c557ce056943 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:09.623084 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1305a-ebb4-4528-a48c-c557ce056943 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:09.623367 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1305a-ebb4-4528-a48c-c557ce056943 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:09.624788 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 513/1004] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:09.630827 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64c7d3-162f-4fd8-908b-94f65414de09 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:09.631641 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64c7d3-162f-4fd8-908b-94f65414de09 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:09.632099 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64c7d3-162f-4fd8-908b-94f65414de09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:09.650898 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-5a64c7d3-162f-4fd8-908b-94f65414de09 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:09.652263 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-5a64c7d3-162f-4fd8-908b-94f65414de09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:09.664704 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 492/1005] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:54:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:09.708292 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1305a-ebb4-4528-a48c-c557ce056943 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:09.721846 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1305a-ebb4-4528-a48c-c557ce056943 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:09.727666 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6787cd-32c8-4ed8-acab-51d9921dd82f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:09.728446 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6787cd-32c8-4ed8-acab-51d9921dd82f service nova] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:09.728879 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6787cd-32c8-4ed8-acab-51d9921dd82f service nova] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:09.729257 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6787cd-32c8-4ed8-acab-51d9921dd82f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:09.737611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6787cd-32c8-4ed8-acab-51d9921dd82f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:09.739933 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6787cd-32c8-4ed8-acab-51d9921dd82f service nova] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:09.749853 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 514/1006] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:12.084150 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de5bbd-78ab-476b-9d31-a70412e434a6 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:12.084683 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de5bbd-78ab-476b-9d31-a70412e434a6 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:12.084683 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de5bbd-78ab-476b-9d31-a70412e434a6 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:12.085967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 493/1007] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:54:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:12.091394 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b87c8-f650-4ada-bcce-3cd81aed6fe2 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:12.091874 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b87c8-f650-4ada-bcce-3cd81aed6fe2 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:12.091997 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b87c8-f650-4ada-bcce-3cd81aed6fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:12.110331 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-d09b87c8-f650-4ada-bcce-3cd81aed6fe2 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:12.111540 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-d09b87c8-f650-4ada-bcce-3cd81aed6fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:12.119978 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 515/1008] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:54:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:12.165851 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de5bbd-78ab-476b-9d31-a70412e434a6 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:12.183208 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de5bbd-78ab-476b-9d31-a70412e434a6 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:12.189776 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6ec75-a0d2-4f23-9ba5-65618640ca1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:12.190590 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6ec75-a0d2-4f23-9ba5-65618640ca1d service nova] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:12.191041 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6ec75-a0d2-4f23-9ba5-65618640ca1d service nova] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:12.191388 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6ec75-a0d2-4f23-9ba5-65618640ca1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:12.202100 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6ec75-a0d2-4f23-9ba5-65618640ca1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:12.204304 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6ec75-a0d2-4f23-9ba5-65618640ca1d service nova] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:12.217387 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 494/1009] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:15.122423 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab5e12-cf01-4291-a189-1bb1fb4031fc None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:15.123048 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab5e12-cf01-4291-a189-1bb1fb4031fc None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:15.123048 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab5e12-cf01-4291-a189-1bb1fb4031fc None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:15.124398 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 516/1010] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:15.131381 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5d270-39a1-4212-9ae2-993b626e9870 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:15.132281 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5d270-39a1-4212-9ae2-993b626e9870 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:15.132281 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5d270-39a1-4212-9ae2-993b626e9870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:15.151068 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-4cc5d270-39a1-4212-9ae2-993b626e9870 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:15.152876 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-4cc5d270-39a1-4212-9ae2-993b626e9870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:15.166122 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 495/1011] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:54:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 08:54:15.225232 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab5e12-cf01-4291-a189-1bb1fb4031fc None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:15.239933 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab5e12-cf01-4291-a189-1bb1fb4031fc None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:15.245237 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7dbba-c878-47d2-b942-c9eb0afb4f6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:15.245871 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7dbba-c878-47d2-b942-c9eb0afb4f6b service nova] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:15.246121 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7dbba-c878-47d2-b942-c9eb0afb4f6b service nova] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:15.246393 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7dbba-c878-47d2-b942-c9eb0afb4f6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:15.255727 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7dbba-c878-47d2-b942-c9eb0afb4f6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:15.270161 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7dbba-c878-47d2-b942-c9eb0afb4f6b service nova] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:15.270161 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 517/1012] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 08:54:18.609631 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbd964-0e19-4715-9a08-0b72340b5234 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:18.610347 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbd964-0e19-4715-9a08-0b72340b5234 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:18.610347 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbd964-0e19-4715-9a08-0b72340b5234 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:18.611626 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 496/1013] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:18.617116 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7ba27-c03b-4e29-976c-a6cb3e23dfbf None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:18.617611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7ba27-c03b-4e29-976c-a6cb3e23dfbf None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:18.617705 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7ba27-c03b-4e29-976c-a6cb3e23dfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:18.640266 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-40c7ba27-c03b-4e29-976c-a6cb3e23dfbf None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:18.641884 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-40c7ba27-c03b-4e29-976c-a6cb3e23dfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:18.650157 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 518/1014] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:54:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:18.695556 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbd964-0e19-4715-9a08-0b72340b5234 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:18.709610 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbd964-0e19-4715-9a08-0b72340b5234 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:18.714517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6227c-8989-496b-958c-55b09c8bc4fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:18.715159 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6227c-8989-496b-958c-55b09c8bc4fb service nova] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:18.715441 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6227c-8989-496b-958c-55b09c8bc4fb service nova] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:18.715718 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6227c-8989-496b-958c-55b09c8bc4fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:18.723964 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6227c-8989-496b-958c-55b09c8bc4fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:18.725579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6227c-8989-496b-958c-55b09c8bc4fb service nova] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:18.735111 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 497/1015] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:20.096848 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24297cd-f74c-4d13-8ceb-28422611f748 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:20.097919 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24297cd-f74c-4d13-8ceb-28422611f748 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:20.098249 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24297cd-f74c-4d13-8ceb-28422611f748 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:20.099791 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 519/1016] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:54:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:20.105085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde5af0-8825-4afc-9bcd-2c91035e876c None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:20.105508 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde5af0-8825-4afc-9bcd-2c91035e876c None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:20.105637 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde5af0-8825-4afc-9bcd-2c91035e876c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:20.123480 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-cbde5af0-8825-4afc-9bcd-2c91035e876c None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:20.124682 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-cbde5af0-8825-4afc-9bcd-2c91035e876c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:20.133020 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 498/1017] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:54:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:20.189416 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab92a4-7c7b-4b12-8518-9a36f78cbc79 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:20.192036 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab92a4-7c7b-4b12-8518-9a36f78cbc79 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:20.192036 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab92a4-7c7b-4b12-8518-9a36f78cbc79 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:20.192036 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 520/1018] 10.222.0.18 () {54 vars in 962 bytes} [Mon May 2 08:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:20.197374 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bc637-fcc7-47a4-9c30-76655113b956 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:20.197728 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bc637-fcc7-47a4-9c30-76655113b956 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:20.198004 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bc637-fcc7-47a4-9c30-76655113b956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:20.240637 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-fe9bc637-fcc7-47a4-9c30-76655113b956 None None] MFA Rules not processed for user `b1bb8a2281ef49be8b2501dd399bbfe4`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:20.241957 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-fe9bc637-fcc7-47a4-9c30-76655113b956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:20.301712 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 499/1019] 10.222.0.18 () {58 vars in 1059 bytes} [Mon May 2 08:54:20 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:20.309086 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab92a4-7c7b-4b12-8518-9a36f78cbc79 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:20.320559 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab92a4-7c7b-4b12-8518-9a36f78cbc79 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:20.323956 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d6170-87a9-4887-9b89-45decf4cd40a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1bb8a2281ef49be8b2501dd399bbfe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:20.324620 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d6170-87a9-4887-9b89-45decf4cd40a service glance] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:20.324900 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d6170-87a9-4887-9b89-45decf4cd40a service glance] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:20.325194 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d6170-87a9-4887-9b89-45decf4cd40a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:20.334205 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d6170-87a9-4887-9b89-45decf4cd40a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:20.335636 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d6170-87a9-4887-9b89-45decf4cd40a service glance] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:20.345633 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 521/1020] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:21.225717 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f59e38-0c0f-43ec-aee3-ed7578c31fd3 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:21.226363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f59e38-0c0f-43ec-aee3-ed7578c31fd3 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:21.226363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f59e38-0c0f-43ec-aee3-ed7578c31fd3 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:21.227613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 500/1021] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:21.232976 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e67b4-5b8f-4e8c-b26d-96aef55d17e4 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:21.233419 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e67b4-5b8f-4e8c-b26d-96aef55d17e4 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:21.233531 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e67b4-5b8f-4e8c-b26d-96aef55d17e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:21.252341 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-8d1e67b4-5b8f-4e8c-b26d-96aef55d17e4 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:21.253558 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-8d1e67b4-5b8f-4e8c-b26d-96aef55d17e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:21.262337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 522/1022] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:54:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 08:54:21.308788 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f59e38-0c0f-43ec-aee3-ed7578c31fd3 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:21.322692 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f59e38-0c0f-43ec-aee3-ed7578c31fd3 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:21.329933 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab54036-ae30-48a9-a673-1bfb38b472c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:21.330584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab54036-ae30-48a9-a673-1bfb38b472c4 service nova] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:21.330864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab54036-ae30-48a9-a673-1bfb38b472c4 service nova] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:21.331336 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab54036-ae30-48a9-a673-1bfb38b472c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:21.340422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab54036-ae30-48a9-a673-1bfb38b472c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:21.342052 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab54036-ae30-48a9-a673-1bfb38b472c4 service nova] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:21.352073 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 501/1023] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:23.906512 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391cd19-017a-48fb-9968-8e4eaa606758 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:23.907173 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391cd19-017a-48fb-9968-8e4eaa606758 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:23.907173 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391cd19-017a-48fb-9968-8e4eaa606758 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:23.908467 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 523/1024] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:23.918973 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2454765-33d1-4f84-99bc-256ae00334b9 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:23.918973 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2454765-33d1-4f84-99bc-256ae00334b9 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:23.918973 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2454765-33d1-4f84-99bc-256ae00334b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:23.934147 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-b2454765-33d1-4f84-99bc-256ae00334b9 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:23.943039 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-b2454765-33d1-4f84-99bc-256ae00334b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:23.951575 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 502/1025] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:54:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:23.997211 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391cd19-017a-48fb-9968-8e4eaa606758 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:24.010426 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391cd19-017a-48fb-9968-8e4eaa606758 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:24.022373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd880d6-b03c-4607-afbe-9355fd06a74c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:24.023023 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd880d6-b03c-4607-afbe-9355fd06a74c service nova] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:24.023302 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd880d6-b03c-4607-afbe-9355fd06a74c service nova] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:24.023572 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd880d6-b03c-4607-afbe-9355fd06a74c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:24.032242 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd880d6-b03c-4607-afbe-9355fd06a74c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:24.033821 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd880d6-b03c-4607-afbe-9355fd06a74c service nova] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:24.044768 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 524/1026] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 08:54:36.028325 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73982efb-7902-4787-9fcb-e24a56276883 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:36.028895 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73982efb-7902-4787-9fcb-e24a56276883 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:36.028895 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73982efb-7902-4787-9fcb-e24a56276883 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:36.030147 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 503/1027] 10.222.0.18 () {54 vars in 918 bytes} [Mon May 2 08:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:36.035872 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8571f25-9472-4d3b-afa9-534e54941259 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:36.036378 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8571f25-9472-4d3b-afa9-534e54941259 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:36.036519 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8571f25-9472-4d3b-afa9-534e54941259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:36.053985 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-e8571f25-9472-4d3b-afa9-534e54941259 None None] MFA Rules not processed for user `894ff70da3bb45ce858b2d34224eab93`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:36.055178 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-e8571f25-9472-4d3b-afa9-534e54941259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:36.063789 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 525/1028] 10.222.0.18 () {58 vars in 1015 bytes} [Mon May 2 08:54:36 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:36.078158 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d99410-58c9-407a-a668-beab20301a93 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:36.078451 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d99410-58c9-407a-a668-beab20301a93 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:36.078725 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d99410-58c9-407a-a668-beab20301a93 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:36.080040 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 504/1029] 10.222.0.18 () {54 vars in 918 bytes} [Mon May 2 08:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:36.085110 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0756be-0060-42eb-a2f1-e3788011ec55 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:36.085402 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0756be-0060-42eb-a2f1-e3788011ec55 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:36.085683 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0756be-0060-42eb-a2f1-e3788011ec55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:36.114794 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-ab0756be-0060-42eb-a2f1-e3788011ec55 None None] MFA Rules not processed for user `97308967556844019594cd0c4abc41fc`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:36.115949 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-ab0756be-0060-42eb-a2f1-e3788011ec55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:36.124382 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 526/1030] 10.222.0.18 () {58 vars in 1015 bytes} [Mon May 2 08:54:36 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:38.900970 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a20e6-3575-4ed1-8e5c-9eb52e1e2047 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:38.901532 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a20e6-3575-4ed1-8e5c-9eb52e1e2047 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:38.901532 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a20e6-3575-4ed1-8e5c-9eb52e1e2047 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:38.902865 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 505/1031] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 08:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:38.908219 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e347ad3-037a-4cc7-be8a-537eb9d19f41 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:38.908697 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e347ad3-037a-4cc7-be8a-537eb9d19f41 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:38.908801 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e347ad3-037a-4cc7-be8a-537eb9d19f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:38.926844 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-9e347ad3-037a-4cc7-be8a-537eb9d19f41 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:38.928025 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-9e347ad3-037a-4cc7-be8a-537eb9d19f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:38.936140 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 527/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 08:54:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:38.978400 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a20e6-3575-4ed1-8e5c-9eb52e1e2047 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:38.992342 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a20e6-3575-4ed1-8e5c-9eb52e1e2047 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:38.997167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806692de-12f2-4d12-a048-6ac5e495c70a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:38.997797 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806692de-12f2-4d12-a048-6ac5e495c70a service nova] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:38.998079 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806692de-12f2-4d12-a048-6ac5e495c70a service nova] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:38.998352 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806692de-12f2-4d12-a048-6ac5e495c70a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:39.007210 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806692de-12f2-4d12-a048-6ac5e495c70a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:39.008922 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806692de-12f2-4d12-a048-6ac5e495c70a service nova] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:39.018224 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 506/1033] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:40.397868 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4cf4c-fdde-4d09-a92c-5bd08768388a None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:40.398442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4cf4c-fdde-4d09-a92c-5bd08768388a None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:40.398442 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4cf4c-fdde-4d09-a92c-5bd08768388a None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:40.399787 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 528/1034] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 08:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:40.404700 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818216d0-aab1-4869-b4f5-52b4e168c196 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:40.405144 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818216d0-aab1-4869-b4f5-52b4e168c196 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:40.405256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818216d0-aab1-4869-b4f5-52b4e168c196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:40.423847 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-818216d0-aab1-4869-b4f5-52b4e168c196 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:40.426099 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-818216d0-aab1-4869-b4f5-52b4e168c196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:40.433211 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 507/1035] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 08:54:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:40.618186 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4cf4c-fdde-4d09-a92c-5bd08768388a None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:40.631427 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4cf4c-fdde-4d09-a92c-5bd08768388a None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:40.636608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5836a-6461-4a44-a268-0eb70d848707 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:40.637239 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5836a-6461-4a44-a268-0eb70d848707 service nova] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:40.637517 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5836a-6461-4a44-a268-0eb70d848707 service nova] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:40.637785 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5836a-6461-4a44-a268-0eb70d848707 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:40.646518 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5836a-6461-4a44-a268-0eb70d848707 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:40.648164 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5836a-6461-4a44-a268-0eb70d848707 service nova] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:40.657346 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 529/1036] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:41.963846 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c290b-22e3-421f-9729-c6190926328b None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:41.964385 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c290b-22e3-421f-9729-c6190926328b None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:41.964385 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c290b-22e3-421f-9729-c6190926328b None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:41.965724 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 508/1037] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 08:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:41.970805 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645effa-3ba2-481c-a721-a9a6f6147251 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:41.971191 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645effa-3ba2-481c-a721-a9a6f6147251 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:41.971363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645effa-3ba2-481c-a721-a9a6f6147251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:41.989943 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-7645effa-3ba2-481c-a721-a9a6f6147251 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:41.991121 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-7645effa-3ba2-481c-a721-a9a6f6147251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:41.998922 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 530/1038] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 08:54:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:42.157443 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c290b-22e3-421f-9729-c6190926328b None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:42.170546 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c290b-22e3-421f-9729-c6190926328b None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:42.176170 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3c25f-ab8b-4db2-ac04-0438f0476015 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:42.176806 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3c25f-ab8b-4db2-ac04-0438f0476015 service nova] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:42.177086 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3c25f-ab8b-4db2-ac04-0438f0476015 service nova] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:42.177361 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3c25f-ab8b-4db2-ac04-0438f0476015 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:42.185488 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3c25f-ab8b-4db2-ac04-0438f0476015 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:42.187077 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3c25f-ab8b-4db2-ac04-0438f0476015 service nova] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:42.196855 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 509/1039] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:43.491676 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6719dbf-1a45-48ba-b37c-58a3eac4e8b6 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:43.492303 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6719dbf-1a45-48ba-b37c-58a3eac4e8b6 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:43.492303 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6719dbf-1a45-48ba-b37c-58a3eac4e8b6 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:43.493633 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 531/1040] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 08:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:43.498653 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fba5a-2baa-44e7-9410-93844a48fff2 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:43.499066 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fba5a-2baa-44e7-9410-93844a48fff2 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:43.499208 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fba5a-2baa-44e7-9410-93844a48fff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:43.517550 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-b05fba5a-2baa-44e7-9410-93844a48fff2 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:43.519420 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-b05fba5a-2baa-44e7-9410-93844a48fff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:43.527817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 510/1041] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 08:54:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:43.681570 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6719dbf-1a45-48ba-b37c-58a3eac4e8b6 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:43.695017 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6719dbf-1a45-48ba-b37c-58a3eac4e8b6 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:43.700604 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576747f-885c-480b-8608-af1a9915d425 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:43.701231 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576747f-885c-480b-8608-af1a9915d425 service nova] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:43.701513 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576747f-885c-480b-8608-af1a9915d425 service nova] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:43.701788 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576747f-885c-480b-8608-af1a9915d425 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:43.710109 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576747f-885c-480b-8608-af1a9915d425 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:43.711729 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576747f-885c-480b-8608-af1a9915d425 service nova] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:43.720885 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 532/1042] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:45.014021 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706467a-c742-4441-95c2-13ff03b8a6bb None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:45.014540 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706467a-c742-4441-95c2-13ff03b8a6bb None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:45.014637 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706467a-c742-4441-95c2-13ff03b8a6bb None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:45.015911 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 511/1043] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 08:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:45.021544 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a700-f6f2-449a-bd1f-439c959c2e32 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:45.021971 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a700-f6f2-449a-bd1f-439c959c2e32 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:45.022113 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a700-f6f2-449a-bd1f-439c959c2e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:45.040371 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-15f9a700-f6f2-449a-bd1f-439c959c2e32 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:45.041538 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-15f9a700-f6f2-449a-bd1f-439c959c2e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:45.049155 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 533/1044] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 08:54:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:45.200311 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706467a-c742-4441-95c2-13ff03b8a6bb None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:45.213754 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706467a-c742-4441-95c2-13ff03b8a6bb None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:45.218867 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8071e-d14a-4df9-8afa-65cbee813a55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:45.219510 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8071e-d14a-4df9-8afa-65cbee813a55 service nova] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:45.219787 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8071e-d14a-4df9-8afa-65cbee813a55 service nova] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:45.220086 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8071e-d14a-4df9-8afa-65cbee813a55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:45.228834 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8071e-d14a-4df9-8afa-65cbee813a55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:45.230422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8071e-d14a-4df9-8afa-65cbee813a55 service nova] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:45.239766 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 512/1045] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:46.545765 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24849ae8-f0dd-439a-bd3c-3e4b7a7ff3fc None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:46.546338 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24849ae8-f0dd-439a-bd3c-3e4b7a7ff3fc None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:46.546338 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24849ae8-f0dd-439a-bd3c-3e4b7a7ff3fc None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:46.547714 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 534/1046] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 08:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:46.552715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86049f16-d4b6-4234-b1c8-a4bc448acef1 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:46.553151 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86049f16-d4b6-4234-b1c8-a4bc448acef1 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:46.553256 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86049f16-d4b6-4234-b1c8-a4bc448acef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:46.571828 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-86049f16-d4b6-4234-b1c8-a4bc448acef1 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:46.573042 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-86049f16-d4b6-4234-b1c8-a4bc448acef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:46.581236 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 513/1047] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 08:54:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:46.738693 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24849ae8-f0dd-439a-bd3c-3e4b7a7ff3fc None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:46.751930 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24849ae8-f0dd-439a-bd3c-3e4b7a7ff3fc None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:46.757563 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d65d93-ef71-4c89-ab68-193f897232e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:46.758194 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d65d93-ef71-4c89-ab68-193f897232e8 service nova] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:46.758476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d65d93-ef71-4c89-ab68-193f897232e8 service nova] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:46.758753 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d65d93-ef71-4c89-ab68-193f897232e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:46.766709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d65d93-ef71-4c89-ab68-193f897232e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:46.769032 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d65d93-ef71-4c89-ab68-193f897232e8 service nova] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:46.778428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 535/1048] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:48.063994 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bc833-859e-45e0-86cc-79c0cdd76a49 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:48.064553 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bc833-859e-45e0-86cc-79c0cdd76a49 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:48.064553 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bc833-859e-45e0-86cc-79c0cdd76a49 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:48.066506 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 514/1049] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 08:54:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:48.071565 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db659967-7eb4-4c03-8b9f-581371a6839c None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:48.071975 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db659967-7eb4-4c03-8b9f-581371a6839c None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:48.072158 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db659967-7eb4-4c03-8b9f-581371a6839c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:48.089612 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-db659967-7eb4-4c03-8b9f-581371a6839c None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:48.090779 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-db659967-7eb4-4c03-8b9f-581371a6839c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:48.098589 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 536/1050] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 08:54:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:48.251582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bc833-859e-45e0-86cc-79c0cdd76a49 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:48.265751 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bc833-859e-45e0-86cc-79c0cdd76a49 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:48.271602 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28f486-3893-409a-9b12-a11d3f9f77e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:48.272279 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28f486-3893-409a-9b12-a11d3f9f77e5 service nova] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:48.272563 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28f486-3893-409a-9b12-a11d3f9f77e5 service nova] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:48.272839 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28f486-3893-409a-9b12-a11d3f9f77e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:48.280809 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28f486-3893-409a-9b12-a11d3f9f77e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:48.282393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28f486-3893-409a-9b12-a11d3f9f77e5 service nova] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:48.291859 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 515/1051] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:49.613246 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee1575-af9b-4cee-8af3-ef5b89d8b7a1 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:49.613815 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee1575-af9b-4cee-8af3-ef5b89d8b7a1 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:49.613815 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee1575-af9b-4cee-8af3-ef5b89d8b7a1 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:49.615176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 537/1052] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 08:54:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:49.620327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925329be-5802-4ee9-924e-9001870929e4 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:49.620742 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925329be-5802-4ee9-924e-9001870929e4 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:49.620889 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925329be-5802-4ee9-924e-9001870929e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:49.639504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-925329be-5802-4ee9-924e-9001870929e4 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:49.644110 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-925329be-5802-4ee9-924e-9001870929e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:49.649085 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 516/1053] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 08:54:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:49.802337 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee1575-af9b-4cee-8af3-ef5b89d8b7a1 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:49.815757 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee1575-af9b-4cee-8af3-ef5b89d8b7a1 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:49.820737 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2970e-6073-426b-8563-be924d6ce63e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:49.821362 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2970e-6073-426b-8563-be924d6ce63e service nova] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:49.821642 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2970e-6073-426b-8563-be924d6ce63e service nova] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:49.821916 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2970e-6073-426b-8563-be924d6ce63e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:49.829856 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2970e-6073-426b-8563-be924d6ce63e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:49.831437 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2970e-6073-426b-8563-be924d6ce63e service nova] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:49.841002 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 538/1054] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:51.149963 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b948a6e-1d09-4e34-a842-da5afb70406b None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:51.150504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b948a6e-1d09-4e34-a842-da5afb70406b None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:51.150504 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b948a6e-1d09-4e34-a842-da5afb70406b None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:51.151872 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 517/1055] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 08:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:51.156799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184c89d-29ff-401e-92fc-1e41c4a85746 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:51.157208 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184c89d-29ff-401e-92fc-1e41c4a85746 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:51.157357 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184c89d-29ff-401e-92fc-1e41c4a85746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:51.175521 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-7184c89d-29ff-401e-92fc-1e41c4a85746 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:51.176726 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-7184c89d-29ff-401e-92fc-1e41c4a85746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:51.184299 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 539/1056] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 08:54:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:51.337152 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b948a6e-1d09-4e34-a842-da5afb70406b None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:51.350552 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b948a6e-1d09-4e34-a842-da5afb70406b None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:51.355413 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bec9f4-4d89-4321-ab8e-b3cbfffc879f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:51.356064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bec9f4-4d89-4321-ab8e-b3cbfffc879f service nova] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:51.356352 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bec9f4-4d89-4321-ab8e-b3cbfffc879f service nova] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:51.356627 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bec9f4-4d89-4321-ab8e-b3cbfffc879f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:51.365185 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bec9f4-4d89-4321-ab8e-b3cbfffc879f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:51.366765 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bec9f4-4d89-4321-ab8e-b3cbfffc879f service nova] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:51.375953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 518/1057] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:53.640633 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c44abc-e61c-48b9-838d-45c5a4d3ac24 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:53.641278 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c44abc-e61c-48b9-838d-45c5a4d3ac24 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:53.641278 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c44abc-e61c-48b9-838d-45c5a4d3ac24 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:53.642545 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 540/1058] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 08:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:53.648579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b236d-f693-4a47-a8bd-14268493fd41 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:53.649046 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b236d-f693-4a47-a8bd-14268493fd41 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:53.649152 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b236d-f693-4a47-a8bd-14268493fd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:53.666495 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-ee8b236d-f693-4a47-a8bd-14268493fd41 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:53.667926 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-ee8b236d-f693-4a47-a8bd-14268493fd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:53.677601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 519/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 08:54:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:53.717067 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c44abc-e61c-48b9-838d-45c5a4d3ac24 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:53.728440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c44abc-e61c-48b9-838d-45c5a4d3ac24 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:53.741093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8802a2e-0efa-4dbd-86ef-2e65a3bfa9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:53.741093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8802a2e-0efa-4dbd-86ef-2e65a3bfa9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:53.741093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8802a2e-0efa-4dbd-86ef-2e65a3bfa9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:53.741093 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8802a2e-0efa-4dbd-86ef-2e65a3bfa9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:53.750370 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8802a2e-0efa-4dbd-86ef-2e65a3bfa9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:53.751863 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8802a2e-0efa-4dbd-86ef-2e65a3bfa9b9 service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:53.762332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 541/1060] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:56.366688 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da242b-cf6e-4fe3-b94b-08a8df885d89 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:56.367276 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da242b-cf6e-4fe3-b94b-08a8df885d89 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:56.367276 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da242b-cf6e-4fe3-b94b-08a8df885d89 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:56.368570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 520/1061] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 08:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:54:56.373898 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f515f45-9f4f-4610-9d93-9600f520ae9a None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:56.374327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f515f45-9f4f-4610-9d93-9600f520ae9a None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:56.374441 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f515f45-9f4f-4610-9d93-9600f520ae9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:56.393508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-1f515f45-9f4f-4610-9d93-9600f520ae9a None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:56.394694 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-1f515f45-9f4f-4610-9d93-9600f520ae9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:56.402625 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 542/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 08:54:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:56.442393 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da242b-cf6e-4fe3-b94b-08a8df885d89 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:56.453158 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da242b-cf6e-4fe3-b94b-08a8df885d89 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:56.456701 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc53fc-980e-4867-851b-e16b11af31b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:56.457333 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc53fc-980e-4867-851b-e16b11af31b3 service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:56.457617 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc53fc-980e-4867-851b-e16b11af31b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:56.457891 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc53fc-980e-4867-851b-e16b11af31b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:56.466489 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc53fc-980e-4867-851b-e16b11af31b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:56.467947 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc53fc-980e-4867-851b-e16b11af31b3 service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:56.477197 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 521/1063] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:54:59.106253 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dd3a1-8053-43bf-9be9-6b1ca47fad37 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:59.106741 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dd3a1-8053-43bf-9be9-6b1ca47fad37 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:59.106850 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dd3a1-8053-43bf-9be9-6b1ca47fad37 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:59.108267 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 543/1064] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 08:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:54:59.114194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcd0af-cf45-4115-87e4-24b09aec7ebc None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:59.114652 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcd0af-cf45-4115-87e4-24b09aec7ebc None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:59.114756 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcd0af-cf45-4115-87e4-24b09aec7ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:59.132647 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-23bcd0af-cf45-4115-87e4-24b09aec7ebc None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:54:59.133881 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-23bcd0af-cf45-4115-87e4-24b09aec7ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:54:59.141561 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 522/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 08:54:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:54:59.180380 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dd3a1-8053-43bf-9be9-6b1ca47fad37 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:54:59.191073 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dd3a1-8053-43bf-9be9-6b1ca47fad37 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:54:59.194477 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27882c-3974-4dca-877a-51d2aafb1350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:54:59.195096 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27882c-3974-4dca-877a-51d2aafb1350 service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:54:59.195373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27882c-3974-4dca-877a-51d2aafb1350 service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:54:59.195639 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27882c-3974-4dca-877a-51d2aafb1350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:54:59.204161 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27882c-3974-4dca-877a-51d2aafb1350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:54:59.206314 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27882c-3974-4dca-877a-51d2aafb1350 service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:54:59.215591 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 544/1066] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:54:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:55:01.621347 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ece9d-af4d-4bca-8702-f113ec83413b None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:01.621910 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ece9d-af4d-4bca-8702-f113ec83413b None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:01.621910 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ece9d-af4d-4bca-8702-f113ec83413b None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:01.623248 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 523/1067] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 08:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:55:01.628641 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee28907-a2a1-4b3c-8b98-e30338558ac1 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:01.629098 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee28907-a2a1-4b3c-8b98-e30338558ac1 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:01.629212 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee28907-a2a1-4b3c-8b98-e30338558ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:01.646820 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-0ee28907-a2a1-4b3c-8b98-e30338558ac1 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:55:01.647988 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-0ee28907-a2a1-4b3c-8b98-e30338558ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:55:01.655586 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 545/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 08:55:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 08:55:01.695053 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ece9d-af4d-4bca-8702-f113ec83413b None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:55:01.706232 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ece9d-af4d-4bca-8702-f113ec83413b None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:55:01.709688 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409898e-24b9-44d5-b2b4-da56e102636a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:55:01.710314 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409898e-24b9-44d5-b2b4-da56e102636a service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:01.710589 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409898e-24b9-44d5-b2b4-da56e102636a service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:01.710857 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409898e-24b9-44d5-b2b4-da56e102636a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:01.719375 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409898e-24b9-44d5-b2b4-da56e102636a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:55:01.721417 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409898e-24b9-44d5-b2b4-da56e102636a service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:55:01.730391 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 524/1069] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:55:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:55:04.057452 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ddd26-bcfc-4d22-b6ef-609f4b10dda7 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:04.057966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ddd26-bcfc-4d22-b6ef-609f4b10dda7 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:04.057966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ddd26-bcfc-4d22-b6ef-609f4b10dda7 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:04.059275 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 546/1070] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 08:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:55:04.064829 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc519762-35d8-4eb4-bed6-eaa9797564ad None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:04.065312 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc519762-35d8-4eb4-bed6-eaa9797564ad None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:04.065429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc519762-35d8-4eb4-bed6-eaa9797564ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:04.082317 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-bc519762-35d8-4eb4-bed6-eaa9797564ad None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:55:04.083483 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-bc519762-35d8-4eb4-bed6-eaa9797564ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:55:04.091102 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 525/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 08:55:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:55:04.129950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ddd26-bcfc-4d22-b6ef-609f4b10dda7 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:55:04.140380 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ddd26-bcfc-4d22-b6ef-609f4b10dda7 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:55:04.143926 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fea570-e2ad-4ac6-ad64-f9159c1958fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:55:04.144583 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fea570-e2ad-4ac6-ad64-f9159c1958fd service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:04.144864 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fea570-e2ad-4ac6-ad64-f9159c1958fd service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:04.145138 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fea570-e2ad-4ac6-ad64-f9159c1958fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:04.153762 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fea570-e2ad-4ac6-ad64-f9159c1958fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:55:04.155190 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fea570-e2ad-4ac6-ad64-f9159c1958fd service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:55:04.164962 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 547/1072] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:55:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 08:55:06.526985 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8c47a-8d7e-4f4b-80a6-9338a83a2bda None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:06.527563 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8c47a-8d7e-4f4b-80a6-9338a83a2bda None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:06.527563 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8c47a-8d7e-4f4b-80a6-9338a83a2bda None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:06.528925 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 526/1073] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 08:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:55:06.534934 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd40cec-ef49-46ad-8ffb-745c6cb2bac3 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:06.535354 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd40cec-ef49-46ad-8ffb-745c6cb2bac3 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:06.535487 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd40cec-ef49-46ad-8ffb-745c6cb2bac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:06.553447 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-9dd40cec-ef49-46ad-8ffb-745c6cb2bac3 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:55:06.554625 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-9dd40cec-ef49-46ad-8ffb-745c6cb2bac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:55:06.562555 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 548/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 08:55:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:55:06.601062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8c47a-8d7e-4f4b-80a6-9338a83a2bda None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:55:06.611978 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8c47a-8d7e-4f4b-80a6-9338a83a2bda None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:55:06.615419 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b421f-05a6-4afa-8f92-a5b2c7b32296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:55:06.616079 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b421f-05a6-4afa-8f92-a5b2c7b32296 service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:06.616368 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b421f-05a6-4afa-8f92-a5b2c7b32296 service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:06.616645 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b421f-05a6-4afa-8f92-a5b2c7b32296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:06.625206 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b421f-05a6-4afa-8f92-a5b2c7b32296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:55:06.626707 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b421f-05a6-4afa-8f92-a5b2c7b32296 service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:55:06.635952 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 527/1075] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:55:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:55:08.992774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff14610-ce3c-4244-a728-2be2402ed005 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:08.993257 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff14610-ce3c-4244-a728-2be2402ed005 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:08.993355 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff14610-ce3c-4244-a728-2be2402ed005 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:08.994727 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 549/1076] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 08:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:55:09.000203 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddba008-7cb4-41a0-b46a-868775796bf4 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:09.000636 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddba008-7cb4-41a0-b46a-868775796bf4 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:09.000771 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddba008-7cb4-41a0-b46a-868775796bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:09.018861 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-2ddba008-7cb4-41a0-b46a-868775796bf4 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:55:09.020030 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-2ddba008-7cb4-41a0-b46a-868775796bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:55:09.027644 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 528/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 08:55:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:55:09.068012 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff14610-ce3c-4244-a728-2be2402ed005 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:55:09.078324 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff14610-ce3c-4244-a728-2be2402ed005 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:55:09.082492 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d546a6-04ed-4227-86dc-93a86f6fd8d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:55:09.083111 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d546a6-04ed-4227-86dc-93a86f6fd8d8 service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:09.083388 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d546a6-04ed-4227-86dc-93a86f6fd8d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:09.083656 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d546a6-04ed-4227-86dc-93a86f6fd8d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:09.092416 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d546a6-04ed-4227-86dc-93a86f6fd8d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:55:09.093843 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d546a6-04ed-4227-86dc-93a86f6fd8d8 service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:55:09.103562 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 550/1078] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:55:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:55:11.431209 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de6899-e4db-429f-a989-bd80080cce89 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:11.431787 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de6899-e4db-429f-a989-bd80080cce89 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:11.431787 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de6899-e4db-429f-a989-bd80080cce89 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:11.433149 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 529/1079] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 08:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:55:11.438531 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110f32e-b69b-4b17-8960-40c96c62b176 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:11.438960 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110f32e-b69b-4b17-8960-40c96c62b176 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:11.439104 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110f32e-b69b-4b17-8960-40c96c62b176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:11.456850 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-d110f32e-b69b-4b17-8960-40c96c62b176 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:55:11.458014 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-d110f32e-b69b-4b17-8960-40c96c62b176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:55:11.465604 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 551/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 08:55:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:55:11.503625 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de6899-e4db-429f-a989-bd80080cce89 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:55:11.513947 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de6899-e4db-429f-a989-bd80080cce89 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:55:11.517959 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48387764-d4f6-42c9-8901-3dc8f3a9be47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:55:11.518731 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48387764-d4f6-42c9-8901-3dc8f3a9be47 service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:11.519016 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48387764-d4f6-42c9-8901-3dc8f3a9be47 service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:11.519290 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48387764-d4f6-42c9-8901-3dc8f3a9be47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:11.527889 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48387764-d4f6-42c9-8901-3dc8f3a9be47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:55:11.529357 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48387764-d4f6-42c9-8901-3dc8f3a9be47 service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:55:11.538632 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 530/1081] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:55:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:55:13.893003 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d543f-f741-4711-8f47-ef45b13b7c62 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:13.893558 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d543f-f741-4711-8f47-ef45b13b7c62 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:13.893558 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d543f-f741-4711-8f47-ef45b13b7c62 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:13.894977 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 552/1082] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 08:55:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:55:13.900353 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fcf1c-7706-4f4b-838c-31f80c5f251c None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:13.900752 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fcf1c-7706-4f4b-838c-31f80c5f251c None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:13.900913 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fcf1c-7706-4f4b-838c-31f80c5f251c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:13.918726 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-4e1fcf1c-7706-4f4b-838c-31f80c5f251c None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:55:13.919846 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-4e1fcf1c-7706-4f4b-838c-31f80c5f251c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:55:13.929083 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 531/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 08:55:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:55:13.967180 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d543f-f741-4711-8f47-ef45b13b7c62 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:55:13.978141 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d543f-f741-4711-8f47-ef45b13b7c62 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:55:13.981577 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29d3b8-8776-409e-81f5-64b37943675e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:55:13.982200 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29d3b8-8776-409e-81f5-64b37943675e service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:13.982478 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29d3b8-8776-409e-81f5-64b37943675e service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:13.982752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29d3b8-8776-409e-81f5-64b37943675e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:13.992026 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29d3b8-8776-409e-81f5-64b37943675e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:55:13.993468 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29d3b8-8776-409e-81f5-64b37943675e service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:55:14.002476 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 553/1084] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:55:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:55:16.330553 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdc8bb-df90-44c8-bb2e-743ceda47d41 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:16.331127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdc8bb-df90-44c8-bb2e-743ceda47d41 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:16.331127 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdc8bb-df90-44c8-bb2e-743ceda47d41 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:16.332517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 532/1085] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 08:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:55:16.337873 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1898784-5cd6-4596-bc3c-c4c516fc05b2 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:16.338299 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1898784-5cd6-4596-bc3c-c4c516fc05b2 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:16.338435 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1898784-5cd6-4596-bc3c-c4c516fc05b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:16.356724 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-b1898784-5cd6-4596-bc3c-c4c516fc05b2 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:55:16.358781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-b1898784-5cd6-4596-bc3c-c4c516fc05b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:55:16.366690 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 554/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 08:55:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:55:16.403216 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdc8bb-df90-44c8-bb2e-743ceda47d41 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:55:16.414531 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdc8bb-df90-44c8-bb2e-743ceda47d41 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:55:16.418180 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdf4f9-2ab9-4f71-b0fd-65d43ab81a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:55:16.418951 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdf4f9-2ab9-4f71-b0fd-65d43ab81a54 service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:16.419238 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdf4f9-2ab9-4f71-b0fd-65d43ab81a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:16.419515 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdf4f9-2ab9-4f71-b0fd-65d43ab81a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:16.428533 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdf4f9-2ab9-4f71-b0fd-65d43ab81a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:55:16.429953 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdf4f9-2ab9-4f71-b0fd-65d43ab81a54 service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:55:16.439277 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 533/1087] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:55:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:55:50.922757 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc953a-e97f-41b2-93c5-ec4f050bef80 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:50.923328 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc953a-e97f-41b2-93c5-ec4f050bef80 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:50.923328 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc953a-e97f-41b2-93c5-ec4f050bef80 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:50.924675 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 555/1088] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:55:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:55:50.929704 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf8080-ab34-4d20-82ae-41d4470cee0a None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:50.930152 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf8080-ab34-4d20-82ae-41d4470cee0a None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:50.930261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf8080-ab34-4d20-82ae-41d4470cee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:50.948421 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-6cbf8080-ab34-4d20-82ae-41d4470cee0a None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:55:50.949603 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-6cbf8080-ab34-4d20-82ae-41d4470cee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:55:50.957286 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 534/1089] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:55:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:55:51.007692 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31f61e-053f-45fc-9a1e-b7a231c745db None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:51.007978 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31f61e-053f-45fc-9a1e-b7a231c745db None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:51.008283 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31f61e-053f-45fc-9a1e-b7a231c745db None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:51.009631 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 556/1090] 10.222.0.18 () {54 vars in 962 bytes} [Mon May 2 08:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:55:51.014534 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9741f4-8c0a-4179-823d-b685f71f4551 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:51.014823 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9741f4-8c0a-4179-823d-b685f71f4551 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:51.015099 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9741f4-8c0a-4179-823d-b685f71f4551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:51.043816 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-2c9741f4-8c0a-4179-823d-b685f71f4551 None None] MFA Rules not processed for user `b1bb8a2281ef49be8b2501dd399bbfe4`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:55:51.045045 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-2c9741f4-8c0a-4179-823d-b685f71f4551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:55:51.052066 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 535/1091] 10.222.0.18 () {58 vars in 1059 bytes} [Mon May 2 08:55:51 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 08:55:51.059733 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31f61e-053f-45fc-9a1e-b7a231c745db None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:55:51.070780 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31f61e-053f-45fc-9a1e-b7a231c745db None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:55:51.074486 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ac136-b4ca-4f0f-970c-679cc901c796 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1bb8a2281ef49be8b2501dd399bbfe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:55:51.075241 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ac136-b4ca-4f0f-970c-679cc901c796 service glance] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:51.075525 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ac136-b4ca-4f0f-970c-679cc901c796 service glance] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:51.075802 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ac136-b4ca-4f0f-970c-679cc901c796 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:51.085433 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ac136-b4ca-4f0f-970c-679cc901c796 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:55:51.086947 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ac136-b4ca-4f0f-970c-679cc901c796 service glance] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:55:51.097088 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 557/1092] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:55:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:55:53.443761 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9050f58-048f-4390-9e5e-b62ed1d4c99e None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:53.444375 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9050f58-048f-4390-9e5e-b62ed1d4c99e None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:53.444375 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9050f58-048f-4390-9e5e-b62ed1d4c99e None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:53.445689 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 536/1093] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:55:53.450754 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d5c46-001a-4bb9-9aab-9fdb526ebffd None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:53.451184 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d5c46-001a-4bb9-9aab-9fdb526ebffd None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:53.451302 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d5c46-001a-4bb9-9aab-9fdb526ebffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:53.468379 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-ca5d5c46-001a-4bb9-9aab-9fdb526ebffd None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:55:53.469552 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-ca5d5c46-001a-4bb9-9aab-9fdb526ebffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:55:53.477514 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 558/1094] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:55:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 08:55:53.501823 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9050f58-048f-4390-9e5e-b62ed1d4c99e None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:55:53.514242 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9050f58-048f-4390-9e5e-b62ed1d4c99e None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:55:53.518659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de45d70-3ab3-4a06-a1d9-5c587d8b5b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:55:53.519298 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de45d70-3ab3-4a06-a1d9-5c587d8b5b79 admin admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:53.519582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de45d70-3ab3-4a06-a1d9-5c587d8b5b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:53.519857 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de45d70-3ab3-4a06-a1d9-5c587d8b5b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:53.520620 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de45d70-3ab3-4a06-a1d9-5c587d8b5b79 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:55:53.522326 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: WARNING py.warnings [None req-3de45d70-3ab3-4a06-a1d9-5c587d8b5b79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 08:55:53.522326 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: warnings.warn(msg) May 02 08:55:53.522326 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: May 02 08:55:53.523452 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de45d70-3ab3-4a06-a1d9-5c587d8b5b79 admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:55:53.541330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 537/1095] 10.222.0.18 () {56 vars in 1108 bytes} [Mon May 2 08:55:53 2022] GET /identity/v3/projects => generated 1606 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 08:55:55.851777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d076de0-544e-45df-ab40-0719d841be5b None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:55.852427 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d076de0-544e-45df-ab40-0719d841be5b None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:55.852427 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d076de0-544e-45df-ab40-0719d841be5b None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:55.853693 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 559/1096] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:55:55.858698 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe26da6-9f15-47be-9ca5-19fa929ae453 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:55.859702 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe26da6-9f15-47be-9ca5-19fa929ae453 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:55.859801 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe26da6-9f15-47be-9ca5-19fa929ae453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:55.877313 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-2fe26da6-9f15-47be-9ca5-19fa929ae453 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:55:55.878489 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-2fe26da6-9f15-47be-9ca5-19fa929ae453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:55:55.886172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 538/1097] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:55:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:55:55.929496 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d076de0-544e-45df-ab40-0719d841be5b None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:55:55.942930 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d076de0-544e-45df-ab40-0719d841be5b None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:55:55.947714 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02780f40-98f1-42cc-9457-900be0b92207 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:55:55.948377 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02780f40-98f1-42cc-9457-900be0b92207 service nova] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:55.948683 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02780f40-98f1-42cc-9457-900be0b92207 service nova] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:55.948954 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02780f40-98f1-42cc-9457-900be0b92207 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:55.956709 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02780f40-98f1-42cc-9457-900be0b92207 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:55:55.958267 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02780f40-98f1-42cc-9457-900be0b92207 service nova] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:55:55.967225 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 560/1098] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:55:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:55:58.473389 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229298e-4b66-4c70-8d2a-e4c477df68ea None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:58.473959 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229298e-4b66-4c70-8d2a-e4c477df68ea None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:58.473959 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229298e-4b66-4c70-8d2a-e4c477df68ea None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:58.475284 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 539/1099] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:55:58.480343 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a24f7-dde4-4f38-bd3c-9fc14c8b8e90 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:58.480791 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a24f7-dde4-4f38-bd3c-9fc14c8b8e90 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:58.480897 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a24f7-dde4-4f38-bd3c-9fc14c8b8e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:58.498477 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-442a24f7-dde4-4f38-bd3c-9fc14c8b8e90 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:55:58.500379 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-442a24f7-dde4-4f38-bd3c-9fc14c8b8e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:55:58.507996 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 561/1100] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:55:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:55:58.544020 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229298e-4b66-4c70-8d2a-e4c477df68ea None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:55:58.555205 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229298e-4b66-4c70-8d2a-e4c477df68ea None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:55:58.558909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed409d6-9c9f-4e61-aa49-acad77b32b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:55:58.559543 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed409d6-9c9f-4e61-aa49-acad77b32b05 service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:55:58.559829 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed409d6-9c9f-4e61-aa49-acad77b32b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:55:58.560136 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed409d6-9c9f-4e61-aa49-acad77b32b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:55:58.569903 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed409d6-9c9f-4e61-aa49-acad77b32b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:55:58.571337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed409d6-9c9f-4e61-aa49-acad77b32b05 service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:55:58.580809 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 540/1101] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:55:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:56:00.915998 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdfddf-e93a-43c8-b34f-70210d397ae0 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:56:00.916580 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdfddf-e93a-43c8-b34f-70210d397ae0 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:56:00.916580 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdfddf-e93a-43c8-b34f-70210d397ae0 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:56:00.917866 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 562/1102] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:56:00.923655 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9af2-ae1d-4a7b-ade2-cb5c285f03d4 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:56:00.924140 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9af2-ae1d-4a7b-ade2-cb5c285f03d4 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:56:00.924278 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9af2-ae1d-4a7b-ade2-cb5c285f03d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:56:00.942600 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-6d1d9af2-ae1d-4a7b-ade2-cb5c285f03d4 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:56:00.943789 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-6d1d9af2-ae1d-4a7b-ade2-cb5c285f03d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:56:00.951458 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 541/1103] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:56:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:56:00.989090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdfddf-e93a-43c8-b34f-70210d397ae0 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:56:01.000272 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdfddf-e93a-43c8-b34f-70210d397ae0 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:56:01.004291 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23506a-1104-49c3-812e-3e11d59b1f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:56:01.004439 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23506a-1104-49c3-812e-3e11d59b1f60 service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:56:01.004668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23506a-1104-49c3-812e-3e11d59b1f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:56:01.004940 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23506a-1104-49c3-812e-3e11d59b1f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:56:01.014232 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23506a-1104-49c3-812e-3e11d59b1f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:56:01.015686 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23506a-1104-49c3-812e-3e11d59b1f60 service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:56:01.024916 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 563/1104] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:56:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:56:03.481776 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323a19f-ee1c-41ff-a224-6ef5f5944124 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:56:03.482348 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323a19f-ee1c-41ff-a224-6ef5f5944124 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:56:03.482348 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323a19f-ee1c-41ff-a224-6ef5f5944124 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:56:03.484359 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 542/1105] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:56:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:56:03.489684 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2065e79-d391-4d07-b00c-e8dd8c61e753 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:56:03.490087 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2065e79-d391-4d07-b00c-e8dd8c61e753 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:56:03.490238 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2065e79-d391-4d07-b00c-e8dd8c61e753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:56:03.507453 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-c2065e79-d391-4d07-b00c-e8dd8c61e753 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:56:03.508664 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-c2065e79-d391-4d07-b00c-e8dd8c61e753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:56:03.516404 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 564/1106] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:56:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:56:03.558276 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323a19f-ee1c-41ff-a224-6ef5f5944124 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:56:03.569319 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323a19f-ee1c-41ff-a224-6ef5f5944124 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:56:03.572791 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6086ca9-96a5-4551-99ff-8ab17f845728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:56:03.573424 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6086ca9-96a5-4551-99ff-8ab17f845728 service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:56:03.573710 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6086ca9-96a5-4551-99ff-8ab17f845728 service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:56:03.573988 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6086ca9-96a5-4551-99ff-8ab17f845728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:56:03.582970 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6086ca9-96a5-4551-99ff-8ab17f845728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:56:03.584462 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6086ca9-96a5-4551-99ff-8ab17f845728 service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:56:03.594275 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 543/1107] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:56:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:56:06.223061 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0632ece-cda7-4f89-9a12-d2a0416a31c1 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:56:06.223600 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0632ece-cda7-4f89-9a12-d2a0416a31c1 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:56:06.223600 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0632ece-cda7-4f89-9a12-d2a0416a31c1 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:56:06.225022 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 565/1108] 10.222.0.18 () {54 vars in 926 bytes} [Mon May 2 08:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:56:06.230248 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0254a-01eb-4446-a3db-61ad3f8a0546 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:56:06.230703 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0254a-01eb-4446-a3db-61ad3f8a0546 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:56:06.230807 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0254a-01eb-4446-a3db-61ad3f8a0546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:56:06.249535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-09a0254a-01eb-4446-a3db-61ad3f8a0546 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:56:06.250682 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-09a0254a-01eb-4446-a3db-61ad3f8a0546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:56:06.258580 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 544/1109] 10.222.0.18 () {58 vars in 1023 bytes} [Mon May 2 08:56:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:56:06.297734 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0632ece-cda7-4f89-9a12-d2a0416a31c1 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:56:06.308309 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0632ece-cda7-4f89-9a12-d2a0416a31c1 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:56:06.312261 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64598f1-6c47-408d-bf4d-2a44deee3ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:56:06.312881 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64598f1-6c47-408d-bf4d-2a44deee3ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:56:06.313154 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64598f1-6c47-408d-bf4d-2a44deee3ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:56:06.313422 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64598f1-6c47-408d-bf4d-2a44deee3ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:56:06.322315 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64598f1-6c47-408d-bf4d-2a44deee3ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:56:06.323808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64598f1-6c47-408d-bf4d-2a44deee3ff8 service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:56:06.334025 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 566/1110] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:56:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:58:11.523038 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0640c6-1833-4ff7-b831-89c57a0354fd None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:58:11.523678 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0640c6-1833-4ff7-b831-89c57a0354fd None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:58:11.523678 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0640c6-1833-4ff7-b831-89c57a0354fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:58:11.542829 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-cc0640c6-1833-4ff7-b831-89c57a0354fd None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:58:11.551910 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-cc0640c6-1833-4ff7-b831-89c57a0354fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:58:11.551910 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 545/1111] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 08:58:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:58:11.559833 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8478fc-f50e-4338-b6cd-8bcfbcaa4a1a None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:58:11.560368 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8478fc-f50e-4338-b6cd-8bcfbcaa4a1a None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:58:11.560470 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8478fc-f50e-4338-b6cd-8bcfbcaa4a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:58:11.577787 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-0b8478fc-f50e-4338-b6cd-8bcfbcaa4a1a None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:58:11.578956 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-0b8478fc-f50e-4338-b6cd-8bcfbcaa4a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:58:11.586654 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 567/1112] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 08:58:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:58:11.591613 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0640c6-1833-4ff7-b831-89c57a0354fd None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:58:11.600979 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0640c6-1833-4ff7-b831-89c57a0354fd None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:58:11.606343 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c657b-9b00-4f93-a789-a2200cd25556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:58:11.606994 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c657b-9b00-4f93-a789-a2200cd25556 admin admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:58:11.607277 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c657b-9b00-4f93-a789-a2200cd25556 admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:58:11.607552 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c657b-9b00-4f93-a789-a2200cd25556 admin admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:58:11.608332 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c657b-9b00-4f93-a789-a2200cd25556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 08:58:11.608644 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c657b-9b00-4f93-a789-a2200cd25556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:58:11.609664 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: WARNING py.warnings [None req-e08c657b-9b00-4f93-a789-a2200cd25556 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 08:58:11.609664 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: warnings.warn(msg) May 02 08:58:11.609664 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: May 02 08:58:11.610539 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c657b-9b00-4f93-a789-a2200cd25556 admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:58:11.622068 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 546/1113] 10.222.0.18 () {58 vars in 1152 bytes} [Mon May 2 08:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:58:11.629660 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8478fc-f50e-4338-b6cd-8bcfbcaa4a1a None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:58:11.638906 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8478fc-f50e-4338-b6cd-8bcfbcaa4a1a None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:58:11.643509 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d97d2-989f-44ba-87ee-046b730d3a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:58:11.644204 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d97d2-989f-44ba-87ee-046b730d3a98 admin admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:58:11.644490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d97d2-989f-44ba-87ee-046b730d3a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:58:11.644797 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d97d2-989f-44ba-87ee-046b730d3a98 admin admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:58:11.645485 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d97d2-989f-44ba-87ee-046b730d3a98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:58:11.647236 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: WARNING py.warnings [None req-521d97d2-989f-44ba-87ee-046b730d3a98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 08:58:11.647236 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: warnings.warn(msg) May 02 08:58:11.647236 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: May 02 08:58:11.648463 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d97d2-989f-44ba-87ee-046b730d3a98 admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:58:11.737216 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 568/1114] 10.222.0.18 () {60 vars in 1152 bytes} [Mon May 2 08:58:11 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:58:11.741540 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c657b-9b00-4f93-a789-a2200cd25556 admin admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:58:11.751518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c657b-9b00-4f93-a789-a2200cd25556 admin admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:58:11.805392 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811272c2-355a-4b2a-91c2-3cdeaceee302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:58:11.805986 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811272c2-355a-4b2a-91c2-3cdeaceee302 admin admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:58:11.806274 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811272c2-355a-4b2a-91c2-3cdeaceee302 admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:58:11.806555 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811272c2-355a-4b2a-91c2-3cdeaceee302 admin admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:58:11.807335 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811272c2-355a-4b2a-91c2-3cdeaceee302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:58:11.808472 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: WARNING py.warnings [None req-811272c2-355a-4b2a-91c2-3cdeaceee302 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 08:58:11.808472 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: warnings.warn(msg) May 02 08:58:11.808472 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: May 02 08:58:11.809670 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811272c2-355a-4b2a-91c2-3cdeaceee302 admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:58:11.902126 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 547/1115] 10.222.0.18 () {60 vars in 1143 bytes} [Mon May 2 08:58:11 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 08:58:11.906266 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d97d2-989f-44ba-87ee-046b730d3a98 admin admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:58:11.917182 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d97d2-989f-44ba-87ee-046b730d3a98 admin admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:58:11.921720 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce61a9b-5592-4fa4-b9f9-d1ed9d512bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:58:11.922370 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce61a9b-5592-4fa4-b9f9-d1ed9d512bcd admin admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:58:11.922649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce61a9b-5592-4fa4-b9f9-d1ed9d512bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:58:11.922920 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce61a9b-5592-4fa4-b9f9-d1ed9d512bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:58:11.923741 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce61a9b-5592-4fa4-b9f9-d1ed9d512bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:58:11.924782 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: WARNING py.warnings [None req-cce61a9b-5592-4fa4-b9f9-d1ed9d512bcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 08:58:11.924782 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: warnings.warn(msg) May 02 08:58:11.924782 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: May 02 08:58:11.925655 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce61a9b-5592-4fa4-b9f9-d1ed9d512bcd admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:58:11.939524 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 569/1116] 10.222.0.18 () {58 vars in 1121 bytes} [Mon May 2 08:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 08:58:11.943526 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811272c2-355a-4b2a-91c2-3cdeaceee302 admin admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:58:11.954275 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811272c2-355a-4b2a-91c2-3cdeaceee302 admin admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:58:11.959039 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92ca04-4adf-4381-8f6d-a3fec3a4d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:58:11.959695 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92ca04-4adf-4381-8f6d-a3fec3a4d319 admin admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:58:11.959975 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92ca04-4adf-4381-8f6d-a3fec3a4d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:58:11.960297 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92ca04-4adf-4381-8f6d-a3fec3a4d319 admin admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:58:11.961014 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92ca04-4adf-4381-8f6d-a3fec3a4d319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:58:11.962027 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: WARNING py.warnings [None req-1d92ca04-4adf-4381-8f6d-a3fec3a4d319 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 08:58:11.962027 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: warnings.warn(msg) May 02 08:58:11.962027 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: May 02 08:58:11.962996 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92ca04-4adf-4381-8f6d-a3fec3a4d319 admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:58:11.977076 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 548/1117] 10.222.0.18 () {58 vars in 1121 bytes} [Mon May 2 08:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 08:58:11.981438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce61a9b-5592-4fa4-b9f9-d1ed9d512bcd admin admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:58:11.991080 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce61a9b-5592-4fa4-b9f9-d1ed9d512bcd admin admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:58:11.995659 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636fe35-088d-48fe-9bfd-0ac0698d1b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:58:11.996553 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636fe35-088d-48fe-9bfd-0ac0698d1b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:58:11.996830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636fe35-088d-48fe-9bfd-0ac0698d1b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:58:11.997098 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636fe35-088d-48fe-9bfd-0ac0698d1b1e admin admin] PATH_INFO: `/v3/projects/2d3a6547d2084fd68d4f8d79b14cfaed/users/347fcede712e4c1ea72bf2e7768a275b/roles/722968fb4ca44c1795d61c44f61a78d9` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:58:12.011899 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636fe35-088d-48fe-9bfd-0ac0698d1b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3a6547d2084fd68d4f8d79b14cfaed, user_id=347fcede712e4c1ea72bf2e7768a275b, role_id=722968fb4ca44c1795d61c44f61a78d9)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:58:12.012972 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: WARNING py.warnings [None req-9636fe35-088d-48fe-9bfd-0ac0698d1b1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 08:58:12.012972 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: warnings.warn(msg) May 02 08:58:12.012972 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: May 02 08:58:12.014905 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636fe35-088d-48fe-9bfd-0ac0698d1b1e admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:58:12.168057 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 570/1118] 10.222.0.18 () {60 vars in 1482 bytes} [Mon May 2 08:58:11 2022] PUT /identity/v3/projects/2d3a6547d2084fd68d4f8d79b14cfaed/users/347fcede712e4c1ea72bf2e7768a275b/roles/722968fb4ca44c1795d61c44f61a78d9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:58:12.179219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b4988-97bb-42fd-bf2c-c12b362f2992 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:58:12.179761 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b4988-97bb-42fd-bf2c-c12b362f2992 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:58:12.180109 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b4988-97bb-42fd-bf2c-c12b362f2992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:58:12.205883 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-189b4988-97bb-42fd-bf2c-c12b362f2992 None None] MFA Rules not processed for user `347fcede712e4c1ea72bf2e7768a275b`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:58:12.207106 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-189b4988-97bb-42fd-bf2c-c12b362f2992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:58:12.267971 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 549/1119] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 08:58:12 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:58:12.279285 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636fe35-088d-48fe-9bfd-0ac0698d1b1e admin admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:58:12.344188 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636fe35-088d-48fe-9bfd-0ac0698d1b1e admin admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:58:12.349181 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d2937-1fa1-4e80-aa9b-7458fa70f4f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:58:12.349823 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d2937-1fa1-4e80-aa9b-7458fa70f4f9 service nova] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:58:12.350107 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d2937-1fa1-4e80-aa9b-7458fa70f4f9 service nova] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:58:12.350410 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d2937-1fa1-4e80-aa9b-7458fa70f4f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:58:12.358752 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d2937-1fa1-4e80-aa9b-7458fa70f4f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:58:12.360379 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d2937-1fa1-4e80-aa9b-7458fa70f4f9 service nova] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:58:12.368822 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 571/1120] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:58:12 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:58:12.431469 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4dc1b-44c4-415b-ba1c-fd5df83f6036 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:58:12.431766 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4dc1b-44c4-415b-ba1c-fd5df83f6036 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:58:12.432105 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4dc1b-44c4-415b-ba1c-fd5df83f6036 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:58:12.433706 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 550/1121] 10.222.0.18 () {52 vars in 829 bytes} [Mon May 2 08:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:58:12.437177 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d2937-1fa1-4e80-aa9b-7458fa70f4f9 service nova] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:58:12.497393 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d2937-1fa1-4e80-aa9b-7458fa70f4f9 service nova] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:58:12.501957 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176634b-1eaa-442e-9806-e60fe01afd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:58:12.502810 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176634b-1eaa-442e-9806-e60fe01afd53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:58:12.503090 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176634b-1eaa-442e-9806-e60fe01afd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:58:12.503361 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176634b-1eaa-442e-9806-e60fe01afd53 admin admin] PATH_INFO: `/v3/users/347fcede712e4c1ea72bf2e7768a275b` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:58:12.504579 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176634b-1eaa-442e-9806-e60fe01afd53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=347fcede712e4c1ea72bf2e7768a275b)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:58:12.505580 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: WARNING py.warnings [None req-a176634b-1eaa-442e-9806-e60fe01afd53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 08:58:12.505580 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: warnings.warn(msg) May 02 08:58:12.505580 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: May 02 08:58:12.506760 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176634b-1eaa-442e-9806-e60fe01afd53 admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:58:12.736634 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-a176634b-1eaa-442e-9806-e60fe01afd53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '347fcede712e4c1ea72bf2e7768a275b'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 08:58:12.815369 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-a176634b-1eaa-442e-9806-e60fe01afd53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '347fcede712e4c1ea72bf2e7768a275b'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 08:58:12.816003 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-a176634b-1eaa-442e-9806-e60fe01afd53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '347fcede712e4c1ea72bf2e7768a275b'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 08:58:12.828840 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-a176634b-1eaa-442e-9806-e60fe01afd53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '347fcede712e4c1ea72bf2e7768a275b'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 08:58:12.847159 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-a176634b-1eaa-442e-9806-e60fe01afd53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '347fcede712e4c1ea72bf2e7768a275b'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 08:58:12.853076 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 572/1122] 10.222.0.18 () {58 vars in 1223 bytes} [Mon May 2 08:58:12 2022] DELETE /identity/v3/users/347fcede712e4c1ea72bf2e7768a275b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:58:12.857416 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3b49a-a65f-4c49-8370-9009427238af None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:58:12.857902 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3b49a-a65f-4c49-8370-9009427238af None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:58:12.858019 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3b49a-a65f-4c49-8370-9009427238af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:58:12.874722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-56a3b49a-a65f-4c49-8370-9009427238af None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:58:12.875894 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-56a3b49a-a65f-4c49-8370-9009427238af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:58:12.931223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 551/1123] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 08:58:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:58:12.940808 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176634b-1eaa-442e-9806-e60fe01afd53 admin admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:58:12.942228 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-a176634b-1eaa-442e-9806-e60fe01afd53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:58:13.017353 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176634b-1eaa-442e-9806-e60fe01afd53 admin admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:58:13.020906 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb2d29-0a7b-43e9-86aa-7a19001739f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:58:13.021549 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb2d29-0a7b-43e9-86aa-7a19001739f4 service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:58:13.021833 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb2d29-0a7b-43e9-86aa-7a19001739f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:58:13.022111 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb2d29-0a7b-43e9-86aa-7a19001739f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:58:13.031526 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb2d29-0a7b-43e9-86aa-7a19001739f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:58:13.032903 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb2d29-0a7b-43e9-86aa-7a19001739f4 service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:58:13.042678 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 573/1124] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:58:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:58:13.488378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3b49a-a65f-4c49-8370-9009427238af None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:58:13.489817 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-56a3b49a-a65f-4c49-8370-9009427238af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:58:13.501656 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3b49a-a65f-4c49-8370-9009427238af None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:58:13.506357 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fea43-9bb8-4708-8edf-39f81853fa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:58:13.507219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fea43-9bb8-4708-8edf-39f81853fa71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:58:13.507499 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fea43-9bb8-4708-8edf-39f81853fa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:58:13.507770 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fea43-9bb8-4708-8edf-39f81853fa71 admin admin] PATH_INFO: `/v3/projects/2d3a6547d2084fd68d4f8d79b14cfaed` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:58:13.508968 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06fea43-9bb8-4708-8edf-39f81853fa71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d3a6547d2084fd68d4f8d79b14cfaed)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:58:13.509989 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: WARNING py.warnings [None req-b06fea43-9bb8-4708-8edf-39f81853fa71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 08:58:13.509989 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: warnings.warn(msg) May 02 08:58:13.509989 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: May 02 08:58:13.511828 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06fea43-9bb8-4708-8edf-39f81853fa71 admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:58:13.633985 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-b06fea43-9bb8-4708-8edf-39f81853fa71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d3a6547d2084fd68d4f8d79b14cfaed', 'request_id': 'req-b06fea43-9bb8-4708-8edf-39f81853fa71'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 08:58:13.718749 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-b06fea43-9bb8-4708-8edf-39f81853fa71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d3a6547d2084fd68d4f8d79b14cfaed', 'request_id': 'req-b06fea43-9bb8-4708-8edf-39f81853fa71'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 08:58:13.724995 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-b06fea43-9bb8-4708-8edf-39f81853fa71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d3a6547d2084fd68d4f8d79b14cfaed', 'request_id': 'req-b06fea43-9bb8-4708-8edf-39f81853fa71'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 08:58:13.742936 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-b06fea43-9bb8-4708-8edf-39f81853fa71 admin admin] The token cache is being invalidate because project 2d3a6547d2084fd68d4f8d79b14cfaed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 08:58:13.743223 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-b06fea43-9bb8-4708-8edf-39f81853fa71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 08:58:13.743955 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-b06fea43-9bb8-4708-8edf-39f81853fa71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 08:58:13.746108 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 552/1125] 10.222.0.18 () {58 vars in 1232 bytes} [Mon May 2 08:58:13 2022] DELETE /identity/v3/projects/2d3a6547d2084fd68d4f8d79b14cfaed => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 08:59:33.881924 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ada46f-b883-451f-be7c-6f5611fc05f5 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:33.882522 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ada46f-b883-451f-be7c-6f5611fc05f5 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:33.882522 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ada46f-b883-451f-be7c-6f5611fc05f5 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:33.883878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 574/1126] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 08:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:59:33.889126 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc13038-ed09-47fe-a34c-cedb89f3866b None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:33.889538 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc13038-ed09-47fe-a34c-cedb89f3866b None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:33.889695 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc13038-ed09-47fe-a34c-cedb89f3866b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:33.909787 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-bbc13038-ed09-47fe-a34c-cedb89f3866b None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:59:33.910906 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-bbc13038-ed09-47fe-a34c-cedb89f3866b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:59:33.968579 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 553/1127] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 08:59:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:59:34.123234 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ada46f-b883-451f-be7c-6f5611fc05f5 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:59:34.124958 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-c3ada46f-b883-451f-be7c-6f5611fc05f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:59:34.193282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ada46f-b883-451f-be7c-6f5611fc05f5 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:59:34.198899 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d78c76-f8f4-4e10-80f3-47fc924e15b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:59:34.199539 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d78c76-f8f4-4e10-80f3-47fc924e15b7 service nova] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:34.211608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d78c76-f8f4-4e10-80f3-47fc924e15b7 service nova] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:34.211608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d78c76-f8f4-4e10-80f3-47fc924e15b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:34.211608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d78c76-f8f4-4e10-80f3-47fc924e15b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:59:34.211608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d78c76-f8f4-4e10-80f3-47fc924e15b7 service nova] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:59:34.218730 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 575/1128] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:59:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:59:35.503261 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e150d-0d61-49a0-ac7d-71c26adf309b None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:35.503837 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e150d-0d61-49a0-ac7d-71c26adf309b None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:35.503837 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e150d-0d61-49a0-ac7d-71c26adf309b None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:35.505231 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 554/1129] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 08:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:59:35.510426 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac3ea7-d658-40df-8ed1-75cffdefae3b None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:35.510884 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac3ea7-d658-40df-8ed1-75cffdefae3b None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:35.511230 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac3ea7-d658-40df-8ed1-75cffdefae3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:35.529248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-3aac3ea7-d658-40df-8ed1-75cffdefae3b None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:59:35.530427 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-3aac3ea7-d658-40df-8ed1-75cffdefae3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:59:35.538092 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 576/1130] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 08:59:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 08:59:35.694429 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e150d-0d61-49a0-ac7d-71c26adf309b None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:59:35.707582 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e150d-0d61-49a0-ac7d-71c26adf309b None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:59:35.712641 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3082c-4193-4c02-939c-6ae3d63b2730 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:59:35.713854 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3082c-4193-4c02-939c-6ae3d63b2730 service nova] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:35.714087 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3082c-4193-4c02-939c-6ae3d63b2730 service nova] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:35.714350 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3082c-4193-4c02-939c-6ae3d63b2730 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:35.722468 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3082c-4193-4c02-939c-6ae3d63b2730 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:59:35.724089 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3082c-4193-4c02-939c-6ae3d63b2730 service nova] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:59:35.734202 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 555/1131] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:59:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:59:38.783447 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a1665-2b40-4df9-b448-658dffaafa8b None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:38.783978 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a1665-2b40-4df9-b448-658dffaafa8b None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:38.783978 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a1665-2b40-4df9-b448-658dffaafa8b None None] PATH_INFO: `/v3` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:38.785235 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 577/1132] 10.222.0.20 () {54 vars in 925 bytes} [Mon May 2 08:59:38 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 08:59:38.791117 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cc896-5286-40ec-b837-9c4bd608b0dc None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:38.792022 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cc896-5286-40ec-b837-9c4bd608b0dc None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:38.792265 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cc896-5286-40ec-b837-9c4bd608b0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:38.821742 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-610cc896-5286-40ec-b837-9c4bd608b0dc None None] MFA Rules not processed for user `894ff70da3bb45ce858b2d34224eab93`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:59:38.823227 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-610cc896-5286-40ec-b837-9c4bd608b0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:59:38.883131 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 556/1133] 10.222.0.20 () {58 vars in 1015 bytes} [Mon May 2 08:59:38 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:59:43.117720 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779a9e2-0442-44a2-b162-0f8d58d7a125 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:43.118249 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779a9e2-0442-44a2-b162-0f8d58d7a125 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:43.118249 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779a9e2-0442-44a2-b162-0f8d58d7a125 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:43.119781 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 578/1134] 10.222.0.18 () {54 vars in 960 bytes} [Mon May 2 08:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:59:43.124826 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf82e0-5985-404f-a39c-7898a78e71bd None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:43.125196 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf82e0-5985-404f-a39c-7898a78e71bd None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:43.125479 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf82e0-5985-404f-a39c-7898a78e71bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:43.143176 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-2fdf82e0-5985-404f-a39c-7898a78e71bd None None] MFA Rules not processed for user `894ff70da3bb45ce858b2d34224eab93`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:59:43.144406 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-2fdf82e0-5985-404f-a39c-7898a78e71bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:59:43.153395 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 557/1135] 10.222.0.18 () {58 vars in 1057 bytes} [Mon May 2 08:59:43 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:59:43.160710 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779a9e2-0442-44a2-b162-0f8d58d7a125 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:59:43.174185 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779a9e2-0442-44a2-b162-0f8d58d7a125 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:59:43.179406 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d303a8f-12fa-42d4-9352-9208ae31bf6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ff70da3bb45ce858b2d34224eab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:59:43.182851 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d303a8f-12fa-42d4-9352-9208ae31bf6b service placement] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:43.182851 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d303a8f-12fa-42d4-9352-9208ae31bf6b service placement] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:43.182851 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d303a8f-12fa-42d4-9352-9208ae31bf6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:43.188919 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d303a8f-12fa-42d4-9352-9208ae31bf6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:59:43.190531 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d303a8f-12fa-42d4-9352-9208ae31bf6b service placement] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:59:43.200001 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 579/1136] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:59:43 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 08:59:47.421745 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc881650-0ca8-4fbb-ade5-e6b24e46e30f None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:47.422291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc881650-0ca8-4fbb-ade5-e6b24e46e30f None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:47.422291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc881650-0ca8-4fbb-ade5-e6b24e46e30f None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:47.423642 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 558/1137] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 08:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:59:47.428656 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2706a-8b53-4b7b-ab28-b6fdbc01dd73 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:47.429070 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2706a-8b53-4b7b-ab28-b6fdbc01dd73 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:47.429210 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2706a-8b53-4b7b-ab28-b6fdbc01dd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:47.446609 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-cbb2706a-8b53-4b7b-ab28-b6fdbc01dd73 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:59:47.447794 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-cbb2706a-8b53-4b7b-ab28-b6fdbc01dd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:59:47.455548 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 580/1138] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 08:59:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:59:47.609322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc881650-0ca8-4fbb-ade5-e6b24e46e30f None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:59:47.623160 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc881650-0ca8-4fbb-ade5-e6b24e46e30f None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:59:47.628005 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16673f2-2e43-4f81-bb0e-67018999763f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:59:47.628691 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16673f2-2e43-4f81-bb0e-67018999763f service nova] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:47.628972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16673f2-2e43-4f81-bb0e-67018999763f service nova] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:47.629248 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16673f2-2e43-4f81-bb0e-67018999763f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:47.638079 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16673f2-2e43-4f81-bb0e-67018999763f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:59:47.639686 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16673f2-2e43-4f81-bb0e-67018999763f service nova] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:59:47.648899 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 559/1139] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:59:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:59:48.920673 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4f2e3-8830-492e-9f3b-5b6eba245644 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:48.921458 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4f2e3-8830-492e-9f3b-5b6eba245644 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:48.921458 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4f2e3-8830-492e-9f3b-5b6eba245644 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:48.922479 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 581/1140] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 08:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 08:59:48.928230 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd37761-dc35-4b54-9c67-fdf7a8fb8c3c None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:48.928684 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd37761-dc35-4b54-9c67-fdf7a8fb8c3c None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:48.928933 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd37761-dc35-4b54-9c67-fdf7a8fb8c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:48.948323 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-0fd37761-dc35-4b54-9c67-fdf7a8fb8c3c None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:59:48.949502 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-0fd37761-dc35-4b54-9c67-fdf7a8fb8c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:59:48.957136 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 560/1141] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 08:59:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:59:49.112620 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4f2e3-8830-492e-9f3b-5b6eba245644 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:59:49.128006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4f2e3-8830-492e-9f3b-5b6eba245644 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:59:49.133123 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1b5fa-41a6-4352-aea2-7cc78d8f5bb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:59:49.133768 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1b5fa-41a6-4352-aea2-7cc78d8f5bb5 service nova] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:49.134051 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1b5fa-41a6-4352-aea2-7cc78d8f5bb5 service nova] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:49.134327 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1b5fa-41a6-4352-aea2-7cc78d8f5bb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:49.143777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1b5fa-41a6-4352-aea2-7cc78d8f5bb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:59:49.145478 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1b5fa-41a6-4352-aea2-7cc78d8f5bb5 service nova] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:59:49.155126 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 582/1142] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:59:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:59:53.380280 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53e9a7-339d-41ae-bf25-96a2c63aa68e None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:53.380821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53e9a7-339d-41ae-bf25-96a2c63aa68e None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:53.380821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53e9a7-339d-41ae-bf25-96a2c63aa68e None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:53.382102 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 561/1143] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 08:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:59:53.388016 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab105d-f049-4ff5-8fb4-71d710cd1abe None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:53.388485 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab105d-f049-4ff5-8fb4-71d710cd1abe None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:53.388597 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab105d-f049-4ff5-8fb4-71d710cd1abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:53.408067 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-5eab105d-f049-4ff5-8fb4-71d710cd1abe None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:59:53.409268 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-5eab105d-f049-4ff5-8fb4-71d710cd1abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:59:53.417498 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 583/1144] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 08:59:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 08:59:53.454286 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53e9a7-339d-41ae-bf25-96a2c63aa68e None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:59:53.455935 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-7d53e9a7-339d-41ae-bf25-96a2c63aa68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:59:53.510531 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53e9a7-339d-41ae-bf25-96a2c63aa68e None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:59:53.514522 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65875b-e6b6-4fe4-ae96-605cff47aa75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:59:53.515156 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65875b-e6b6-4fe4-ae96-605cff47aa75 service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:53.515438 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65875b-e6b6-4fe4-ae96-605cff47aa75 service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:53.515717 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65875b-e6b6-4fe4-ae96-605cff47aa75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:53.524453 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65875b-e6b6-4fe4-ae96-605cff47aa75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:59:53.525888 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65875b-e6b6-4fe4-ae96-605cff47aa75 service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:59:53.535004 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 562/1145] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:59:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:59:55.800067 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c09c45-0450-42ec-8c02-3c3406a335d1 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:55.800602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c09c45-0450-42ec-8c02-3c3406a335d1 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:55.800602 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c09c45-0450-42ec-8c02-3c3406a335d1 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:55.802235 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 584/1146] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 08:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:59:55.807224 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979a908-dc15-4a26-8a58-4ed6d672f2d3 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:55.807730 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979a908-dc15-4a26-8a58-4ed6d672f2d3 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:55.807730 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979a908-dc15-4a26-8a58-4ed6d672f2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:55.825778 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-0979a908-dc15-4a26-8a58-4ed6d672f2d3 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:59:55.826983 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-0979a908-dc15-4a26-8a58-4ed6d672f2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:59:55.834673 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 563/1147] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 08:59:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 08:59:55.871395 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c09c45-0450-42ec-8c02-3c3406a335d1 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 08:59:55.882168 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c09c45-0450-42ec-8c02-3c3406a335d1 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 08:59:55.885618 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff1ace-da56-43c4-a70b-035348950af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 08:59:55.886248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff1ace-da56-43c4-a70b-035348950af4 service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:55.886531 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff1ace-da56-43c4-a70b-035348950af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:55.886804 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff1ace-da56-43c4-a70b-035348950af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:55.895508 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff1ace-da56-43c4-a70b-035348950af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 08:59:55.896966 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff1ace-da56-43c4-a70b-035348950af4 service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 08:59:55.906953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 585/1148] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 08:59:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 08:59:59.699926 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0182c-4647-401d-9fed-bc324783b6e0 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:59.700520 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0182c-4647-401d-9fed-bc324783b6e0 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:59.700520 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0182c-4647-401d-9fed-bc324783b6e0 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:59.701864 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 564/1149] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 08:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 08:59:59.707121 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fac008-f73c-45ab-b763-178fe51fbb82 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 08:59:59.707561 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fac008-f73c-45ab-b763-178fe51fbb82 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 08:59:59.707679 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fac008-f73c-45ab-b763-178fe51fbb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 08:59:59.725242 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-d3fac008-f73c-45ab-b763-178fe51fbb82 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 08:59:59.726463 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-d3fac008-f73c-45ab-b763-178fe51fbb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 08:59:59.735012 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 586/1150] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 08:59:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:00:00.006447 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0182c-4647-401d-9fed-bc324783b6e0 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:00:00.008138 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-adb0182c-4647-401d-9fed-bc324783b6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:00:00.075780 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0182c-4647-401d-9fed-bc324783b6e0 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:00:00.079239 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9405e65-7a7a-4ff1-b1d5-e575cfde0ce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351c1af1091f4f97962da2c5e2d330d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:00:00.079880 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9405e65-7a7a-4ff1-b1d5-e575cfde0ce2 service cinder] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:00:00.080194 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9405e65-7a7a-4ff1-b1d5-e575cfde0ce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:00:00.080470 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9405e65-7a7a-4ff1-b1d5-e575cfde0ce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:00:00.089035 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9405e65-7a7a-4ff1-b1d5-e575cfde0ce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:00:00.090583 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9405e65-7a7a-4ff1-b1d5-e575cfde0ce2 service cinder] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:00:00.099610 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 565/1151] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:00:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:00:02.435199 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7bef4-2afa-4290-bd42-50e5a62c9e9d None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:00:02.435735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7bef4-2afa-4290-bd42-50e5a62c9e9d None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:00:02.435853 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7bef4-2afa-4290-bd42-50e5a62c9e9d None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:00:02.437296 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 587/1152] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 09:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:00:02.442565 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119180b-964a-4f3c-a43d-29e085394ee5 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:00:02.443659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119180b-964a-4f3c-a43d-29e085394ee5 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:00:02.443659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119180b-964a-4f3c-a43d-29e085394ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:00:02.461007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-2119180b-964a-4f3c-a43d-29e085394ee5 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:00:02.462128 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-2119180b-964a-4f3c-a43d-29e085394ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:00:02.470730 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 566/1153] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 09:00:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:00:02.745650 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08555732-7cff-4319-88c1-3e7ddfc99398 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:00:02.746586 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08555732-7cff-4319-88c1-3e7ddfc99398 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:00:02.746861 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08555732-7cff-4319-88c1-3e7ddfc99398 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:00:02.748240 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 588/1154] 10.222.0.18 () {54 vars in 963 bytes} [Mon May 2 09:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:00:02.753100 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924382b2-6162-49dc-83fe-dd2144f335cd None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:00:02.753473 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924382b2-6162-49dc-83fe-dd2144f335cd None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:00:02.753751 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924382b2-6162-49dc-83fe-dd2144f335cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:00:02.771124 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-924382b2-6162-49dc-83fe-dd2144f335cd None None] MFA Rules not processed for user `351c1af1091f4f97962da2c5e2d330d5`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:00:02.772332 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-924382b2-6162-49dc-83fe-dd2144f335cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:00:02.779180 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 567/1155] 10.222.0.18 () {58 vars in 1060 bytes} [Mon May 2 09:00:02 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:00:02.786415 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08555732-7cff-4319-88c1-3e7ddfc99398 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:00:02.797356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08555732-7cff-4319-88c1-3e7ddfc99398 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:00:02.800772 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71a379-e033-4dbd-bef9-5f927540d267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351c1af1091f4f97962da2c5e2d330d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:00:02.801649 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71a379-e033-4dbd-bef9-5f927540d267 service cinder] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:00:02.801926 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71a379-e033-4dbd-bef9-5f927540d267 service cinder] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:00:02.802198 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71a379-e033-4dbd-bef9-5f927540d267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:00:02.811454 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71a379-e033-4dbd-bef9-5f927540d267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:00:02.812911 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71a379-e033-4dbd-bef9-5f927540d267 service cinder] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:00:02.822176 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 589/1156] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:00:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:01:22.432845 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abbf6d-97aa-4c2e-92a4-ebd82e70292a None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:22.433506 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abbf6d-97aa-4c2e-92a4-ebd82e70292a None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:22.433506 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abbf6d-97aa-4c2e-92a4-ebd82e70292a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:22.452908 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-d2abbf6d-97aa-4c2e-92a4-ebd82e70292a None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:01:22.454108 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-d2abbf6d-97aa-4c2e-92a4-ebd82e70292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:22.454232 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1627ca-e88e-4a71-b95f-20cbfbc390a9 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:22.454702 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1627ca-e88e-4a71-b95f-20cbfbc390a9 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:22.454800 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1627ca-e88e-4a71-b95f-20cbfbc390a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:22.461822 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 568/1157] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 09:01:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:01:22.471509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c233b-bb08-4dc9-9c88-b8f6ec133180 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:22.471799 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c233b-bb08-4dc9-9c88-b8f6ec133180 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:22.472115 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c233b-bb08-4dc9-9c88-b8f6ec133180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:22.473407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-3d1627ca-e88e-4a71-b95f-20cbfbc390a9 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:01:22.474617 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-3d1627ca-e88e-4a71-b95f-20cbfbc390a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:22.482784 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 590/1158] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 09:01:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 09:01:22.489513 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-237c233b-bb08-4dc9-9c88-b8f6ec133180 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:01:22.490777 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-237c233b-bb08-4dc9-9c88-b8f6ec133180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:22.491669 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47e023-18c7-4298-a743-2390dc037562 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:22.491964 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47e023-18c7-4298-a743-2390dc037562 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:22.492276 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47e023-18c7-4298-a743-2390dc037562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:22.498768 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 569/1159] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 09:01:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 09:01:22.503063 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c233b-bb08-4dc9-9c88-b8f6ec133180 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:22.510722 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-ba47e023-18c7-4298-a743-2390dc037562 None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:01:22.511905 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-ba47e023-18c7-4298-a743-2390dc037562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:22.512291 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c233b-bb08-4dc9-9c88-b8f6ec133180 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:22.516735 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6a8bb-3191-42af-bc9f-397611c46762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:22.517362 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6a8bb-3191-42af-bc9f-397611c46762 admin admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:22.517643 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6a8bb-3191-42af-bc9f-397611c46762 admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:22.517912 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6a8bb-3191-42af-bc9f-397611c46762 admin admin] PATH_INFO: `/v3/domains` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:22.518617 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6a8bb-3191-42af-bc9f-397611c46762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:01:22.518919 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6a8bb-3191-42af-bc9f-397611c46762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:22.519767 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 591/1160] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 09:01:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 09:01:22.520689 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6a8bb-3191-42af-bc9f-397611c46762 admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:22.524163 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47e023-18c7-4298-a743-2390dc037562 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:22.539929 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 570/1161] 10.222.0.18 () {58 vars in 1152 bytes} [Mon May 2 09:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:01:22.540122 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47e023-18c7-4298-a743-2390dc037562 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:22.540122 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b39654-7adf-4646-bec2-be169eb28bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:22.540122 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b39654-7adf-4646-bec2-be169eb28bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:22.540122 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b39654-7adf-4646-bec2-be169eb28bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:22.540533 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b39654-7adf-4646-bec2-be169eb28bb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:22.540953 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b39654-7adf-4646-bec2-be169eb28bb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:01:22.541062 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6a8bb-3191-42af-bc9f-397611c46762 admin admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:22.541361 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b39654-7adf-4646-bec2-be169eb28bb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:22.542385 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: WARNING py.warnings [None req-a7b39654-7adf-4646-bec2-be169eb28bb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 09:01:22.542385 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: warnings.warn(msg) May 02 09:01:22.542385 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: May 02 09:01:22.543282 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b39654-7adf-4646-bec2-be169eb28bb8 admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:22.550650 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6a8bb-3191-42af-bc9f-397611c46762 admin admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:22.555263 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56594f1-6631-49ad-98ea-115ad3f8fac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:22.556456 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56594f1-6631-49ad-98ea-115ad3f8fac8 admin admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:22.556581 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 592/1162] 10.222.0.18 () {58 vars in 1152 bytes} [Mon May 2 09:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:01:22.556924 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56594f1-6631-49ad-98ea-115ad3f8fac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:22.557205 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56594f1-6631-49ad-98ea-115ad3f8fac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:22.557880 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56594f1-6631-49ad-98ea-115ad3f8fac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:22.558888 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: WARNING py.warnings [None req-a56594f1-6631-49ad-98ea-115ad3f8fac8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 09:01:22.558888 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: warnings.warn(msg) May 02 09:01:22.558888 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: May 02 09:01:22.560078 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56594f1-6631-49ad-98ea-115ad3f8fac8 admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:22.564009 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b39654-7adf-4646-bec2-be169eb28bb8 admin admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:22.574080 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b39654-7adf-4646-bec2-be169eb28bb8 admin admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:22.578678 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7b3bd-c0d5-4295-a8d3-1cac0461b327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:22.579315 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7b3bd-c0d5-4295-a8d3-1cac0461b327 admin admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:22.579601 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7b3bd-c0d5-4295-a8d3-1cac0461b327 admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:22.579878 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7b3bd-c0d5-4295-a8d3-1cac0461b327 admin admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:22.580656 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7b3bd-c0d5-4295-a8d3-1cac0461b327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:22.582567 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7b3bd-c0d5-4295-a8d3-1cac0461b327 admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:22.675761 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 571/1163] 10.222.0.18 () {60 vars in 1152 bytes} [Mon May 2 09:01:22 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:01:22.679986 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56594f1-6631-49ad-98ea-115ad3f8fac8 admin admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:22.685553 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 593/1164] 10.222.0.18 () {60 vars in 1152 bytes} [Mon May 2 09:01:22 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:01:22.688438 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7b3bd-c0d5-4295-a8d3-1cac0461b327 admin admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:22.739177 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56594f1-6631-49ad-98ea-115ad3f8fac8 admin admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:22.744417 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279716b-0c4a-46be-a063-a91de4755e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:22.745088 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279716b-0c4a-46be-a063-a91de4755e5a admin admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:22.745374 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279716b-0c4a-46be-a063-a91de4755e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:22.745649 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279716b-0c4a-46be-a063-a91de4755e5a admin admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:22.746340 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279716b-0c4a-46be-a063-a91de4755e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:22.747542 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7b3bd-c0d5-4295-a8d3-1cac0461b327 admin admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:22.748297 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279716b-0c4a-46be-a063-a91de4755e5a admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:22.752127 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264a4a3-1999-4261-90ae-5a1c832e0453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:22.752783 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264a4a3-1999-4261-90ae-5a1c832e0453 admin admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:22.753066 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264a4a3-1999-4261-90ae-5a1c832e0453 admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:22.753338 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264a4a3-1999-4261-90ae-5a1c832e0453 admin admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:22.754009 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264a4a3-1999-4261-90ae-5a1c832e0453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:22.755012 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: WARNING py.warnings [None req-5264a4a3-1999-4261-90ae-5a1c832e0453 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 09:01:22.755012 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: warnings.warn(msg) May 02 09:01:22.755012 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: May 02 09:01:22.756268 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264a4a3-1999-4261-90ae-5a1c832e0453 admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:22.847893 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 572/1165] 10.222.0.18 () {60 vars in 1143 bytes} [Mon May 2 09:01:22 2022] POST /identity/v3/users => generated 290 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:01:22.851743 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279716b-0c4a-46be-a063-a91de4755e5a admin admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:22.861433 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279716b-0c4a-46be-a063-a91de4755e5a admin admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:22.866036 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac431813-4027-45c6-81e8-d4349b23c37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:22.866673 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac431813-4027-45c6-81e8-d4349b23c37b admin admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:22.866955 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac431813-4027-45c6-81e8-d4349b23c37b admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:22.867235 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac431813-4027-45c6-81e8-d4349b23c37b admin admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:22.868001 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac431813-4027-45c6-81e8-d4349b23c37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:22.870250 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac431813-4027-45c6-81e8-d4349b23c37b admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:22.878950 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 594/1166] 10.222.0.18 () {60 vars in 1143 bytes} [Mon May 2 09:01:22 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:01:22.880631 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 573/1167] 10.222.0.18 () {58 vars in 1121 bytes} [Mon May 2 09:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 09:01:22.882995 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264a4a3-1999-4261-90ae-5a1c832e0453 admin admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:22.884689 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac431813-4027-45c6-81e8-d4349b23c37b admin admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:22.893412 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264a4a3-1999-4261-90ae-5a1c832e0453 admin admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:22.893928 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac431813-4027-45c6-81e8-d4349b23c37b admin admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:22.898089 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c15c94-e87e-472c-ab8b-2e464f9f1a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:22.898517 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587da23d-10f2-45e5-b390-aec912688f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:22.898728 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c15c94-e87e-472c-ab8b-2e464f9f1a83 admin admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:22.899005 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c15c94-e87e-472c-ab8b-2e464f9f1a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:22.899162 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587da23d-10f2-45e5-b390-aec912688f41 admin admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:22.899262 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c15c94-e87e-472c-ab8b-2e464f9f1a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:22.899427 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587da23d-10f2-45e5-b390-aec912688f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:22.899731 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587da23d-10f2-45e5-b390-aec912688f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:22.900104 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c15c94-e87e-472c-ab8b-2e464f9f1a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:22.900478 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587da23d-10f2-45e5-b390-aec912688f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:22.901684 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c15c94-e87e-472c-ab8b-2e464f9f1a83 admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:22.902056 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587da23d-10f2-45e5-b390-aec912688f41 admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:22.911576 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 595/1168] 10.222.0.18 () {58 vars in 1121 bytes} [Mon May 2 09:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 09:01:22.912067 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 574/1169] 10.222.0.18 () {58 vars in 1121 bytes} [Mon May 2 09:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 09:01:22.916511 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c15c94-e87e-472c-ab8b-2e464f9f1a83 admin admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:22.916749 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587da23d-10f2-45e5-b390-aec912688f41 admin admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:22.926224 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587da23d-10f2-45e5-b390-aec912688f41 admin admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:22.926373 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c15c94-e87e-472c-ab8b-2e464f9f1a83 admin admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:22.930738 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874e7fd-a5da-4212-9bcc-6edea84d472e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:22.930939 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faa3c4-046d-4cc2-9edc-32342a5c805b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:22.932202 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faa3c4-046d-4cc2-9edc-32342a5c805b admin admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:22.932337 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874e7fd-a5da-4212-9bcc-6edea84d472e admin admin] REQUEST_METHOD: `PUT` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:22.932510 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874e7fd-a5da-4212-9bcc-6edea84d472e admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:22.932615 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faa3c4-046d-4cc2-9edc-32342a5c805b admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:22.932780 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874e7fd-a5da-4212-9bcc-6edea84d472e admin admin] PATH_INFO: `/v3/projects/8147b7f51f8045e79f01167e27a4005d/users/f638d0a6ff5046dcbcef64c8c58d2517/roles/722968fb4ca44c1795d61c44f61a78d9` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:22.932949 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faa3c4-046d-4cc2-9edc-32342a5c805b admin admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:22.933973 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01faa3c4-046d-4cc2-9edc-32342a5c805b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:22.935851 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01faa3c4-046d-4cc2-9edc-32342a5c805b admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:22.946150 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 596/1170] 10.222.0.18 () {58 vars in 1121 bytes} [Mon May 2 09:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 09:01:22.947833 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874e7fd-a5da-4212-9bcc-6edea84d472e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8147b7f51f8045e79f01167e27a4005d, user_id=f638d0a6ff5046dcbcef64c8c58d2517, role_id=722968fb4ca44c1795d61c44f61a78d9)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:22.948932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: WARNING py.warnings [None req-6874e7fd-a5da-4212-9bcc-6edea84d472e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 09:01:22.948932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: warnings.warn(msg) May 02 09:01:22.948932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: May 02 09:01:22.950197 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faa3c4-046d-4cc2-9edc-32342a5c805b admin admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:22.950972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874e7fd-a5da-4212-9bcc-6edea84d472e admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:22.959368 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faa3c4-046d-4cc2-9edc-32342a5c805b admin admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:22.964149 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335edff-504f-4dfc-b0c2-68931c08cfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:22.966689 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335edff-504f-4dfc-b0c2-68931c08cfdd admin admin] REQUEST_METHOD: `PUT` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:22.966689 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335edff-504f-4dfc-b0c2-68931c08cfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:22.966689 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335edff-504f-4dfc-b0c2-68931c08cfdd admin admin] PATH_INFO: `/v3/projects/ad3bd761ff9b4a7fb2e24de76e6b3fe0/users/4afb07e2227944b48853642e43f720a5/roles/722968fb4ca44c1795d61c44f61a78d9` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:22.981662 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335edff-504f-4dfc-b0c2-68931c08cfdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3bd761ff9b4a7fb2e24de76e6b3fe0, user_id=4afb07e2227944b48853642e43f720a5, role_id=722968fb4ca44c1795d61c44f61a78d9)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:22.985332 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335edff-504f-4dfc-b0c2-68931c08cfdd admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:23.018719 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 575/1171] 10.222.0.18 () {60 vars in 1482 bytes} [Mon May 2 09:01:22 2022] PUT /identity/v3/projects/8147b7f51f8045e79f01167e27a4005d/users/f638d0a6ff5046dcbcef64c8c58d2517/roles/722968fb4ca44c1795d61c44f61a78d9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:01:23.023603 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0393e3f-67f9-4ebe-8394-e3b0c758585c None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:23.023893 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0393e3f-67f9-4ebe-8394-e3b0c758585c None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:23.024203 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0393e3f-67f9-4ebe-8394-e3b0c758585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:23.040985 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-b0393e3f-67f9-4ebe-8394-e3b0c758585c None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:01:23.042173 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-b0393e3f-67f9-4ebe-8394-e3b0c758585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:23.076927 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 597/1172] 10.222.0.18 () {60 vars in 1482 bytes} [Mon May 2 09:01:22 2022] PUT /identity/v3/projects/ad3bd761ff9b4a7fb2e24de76e6b3fe0/users/4afb07e2227944b48853642e43f720a5/roles/722968fb4ca44c1795d61c44f61a78d9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:01:23.081943 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fe020-2fed-4633-ac56-4085529102ec None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:23.082235 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fe020-2fed-4633-ac56-4085529102ec None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:23.082509 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fe020-2fed-4633-ac56-4085529102ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:23.098925 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 576/1173] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 09:01:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 09:01:23.099421 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-724fe020-2fed-4633-ac56-4085529102ec None None] MFA Rules not processed for user `01d461fea7474f0cabc39359a0a27117`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:01:23.100637 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-724fe020-2fed-4633-ac56-4085529102ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:23.109749 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0393e3f-67f9-4ebe-8394-e3b0c758585c None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:23.159209 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 598/1174] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 09:01:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:01:23.166159 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0393e3f-67f9-4ebe-8394-e3b0c758585c None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:23.169816 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fe020-2fed-4633-ac56-4085529102ec None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:23.171874 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-724fe020-2fed-4633-ac56-4085529102ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:23.213678 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99623a2-387a-46aa-9723-9e3ee275afe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:23.214258 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99623a2-387a-46aa-9723-9e3ee275afe9 service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:23.214553 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99623a2-387a-46aa-9723-9e3ee275afe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:23.214833 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99623a2-387a-46aa-9723-9e3ee275afe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:23.224060 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99623a2-387a-46aa-9723-9e3ee275afe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:23.225522 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99623a2-387a-46aa-9723-9e3ee275afe9 service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:23.226611 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fe020-2fed-4633-ac56-4085529102ec None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:23.231092 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e91595-d8d0-4c4a-821d-3b70834bfb62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:23.231735 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e91595-d8d0-4c4a-821d-3b70834bfb62 service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:23.232020 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e91595-d8d0-4c4a-821d-3b70834bfb62 service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:23.232330 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e91595-d8d0-4c4a-821d-3b70834bfb62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:23.235668 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 577/1175] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:01:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 09:01:23.241511 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e91595-d8d0-4c4a-821d-3b70834bfb62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:23.242991 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e91595-d8d0-4c4a-821d-3b70834bfb62 service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:23.253174 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 599/1176] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:01:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 09:01:29.620662 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb653d8-71dd-4fa7-a93a-a4e0073816ea None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:29.621568 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb653d8-71dd-4fa7-a93a-a4e0073816ea None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:29.622061 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb653d8-71dd-4fa7-a93a-a4e0073816ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:29.682396 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-4eb653d8-71dd-4fa7-a93a-a4e0073816ea None None] MFA Rules not processed for user `4afb07e2227944b48853642e43f720a5`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:01:29.683648 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-4eb653d8-71dd-4fa7-a93a-a4e0073816ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:29.785307 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 578/1177] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 09:01:29 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:01:29.786561 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e91595-d8d0-4c4a-821d-3b70834bfb62 service neutron] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:29.803506 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69de37-4ce5-4f01-a360-481272d4cb41 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:29.803925 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69de37-4ce5-4f01-a360-481272d4cb41 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:29.804219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69de37-4ce5-4f01-a360-481272d4cb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:29.813585 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e91595-d8d0-4c4a-821d-3b70834bfb62 service neutron] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:29.820634 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94f064-0655-449b-8286-203a2555f94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:29.821937 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94f064-0655-449b-8286-203a2555f94b admin admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:29.822292 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94f064-0655-449b-8286-203a2555f94b admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:29.822640 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94f064-0655-449b-8286-203a2555f94b admin admin] PATH_INFO: `/v3/projects` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:29.823593 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94f064-0655-449b-8286-203a2555f94b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:29.826214 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94f064-0655-449b-8286-203a2555f94b admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:29.833755 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-fe69de37-4ce5-4f01-a360-481272d4cb41 None None] MFA Rules not processed for user `f638d0a6ff5046dcbcef64c8c58d2517`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:01:29.839376 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-fe69de37-4ce5-4f01-a360-481272d4cb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:29.907781 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 579/1178] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 09:01:29 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 09:01:29.912159 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69de37-4ce5-4f01-a360-481272d4cb41 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:29.923306 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69de37-4ce5-4f01-a360-481272d4cb41 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:29.924772 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 600/1179] 10.222.0.18 () {60 vars in 1152 bytes} [Mon May 2 09:01:29 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:01:29.928983 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94f064-0655-449b-8286-203a2555f94b admin admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:29.984660 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a2ae0-e604-4e43-9581-d587e7c967f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:29.985601 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a2ae0-e604-4e43-9581-d587e7c967f6 admin admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:29.986070 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a2ae0-e604-4e43-9581-d587e7c967f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:29.986536 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a2ae0-e604-4e43-9581-d587e7c967f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:29.987227 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a2ae0-e604-4e43-9581-d587e7c967f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:29.989232 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a2ae0-e604-4e43-9581-d587e7c967f6 admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:30.000268 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94f064-0655-449b-8286-203a2555f94b admin admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:30.005724 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d69c4b-b05c-4233-946e-a67e6e0cdad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:30.006356 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d69c4b-b05c-4233-946e-a67e6e0cdad5 admin admin] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:30.006639 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d69c4b-b05c-4233-946e-a67e6e0cdad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:30.006913 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d69c4b-b05c-4233-946e-a67e6e0cdad5 admin admin] PATH_INFO: `/v3/users` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:30.007598 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d69c4b-b05c-4233-946e-a67e6e0cdad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:30.009967 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d69c4b-b05c-4233-946e-a67e6e0cdad5 admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:30.118309 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 580/1180] 10.222.0.18 () {60 vars in 1152 bytes} [Mon May 2 09:01:29 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:01:30.122518 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a2ae0-e604-4e43-9581-d587e7c967f6 admin admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:30.147077 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 601/1181] 10.222.0.18 () {60 vars in 1143 bytes} [Mon May 2 09:01:29 2022] POST /identity/v3/users => generated 299 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:01:30.150120 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d69c4b-b05c-4233-946e-a67e6e0cdad5 admin admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:30.160006 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d69c4b-b05c-4233-946e-a67e6e0cdad5 admin admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:30.193678 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a2ae0-e604-4e43-9581-d587e7c967f6 admin admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:30.199177 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3477a9f-6640-4161-a8f0-9e97bdba94e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:30.200407 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3477a9f-6640-4161-a8f0-9e97bdba94e7 admin admin] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:30.200722 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3477a9f-6640-4161-a8f0-9e97bdba94e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:30.200984 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3477a9f-6640-4161-a8f0-9e97bdba94e7 admin admin] PATH_INFO: `/v3/users` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:30.201666 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3477a9f-6640-4161-a8f0-9e97bdba94e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:30.203822 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3477a9f-6640-4161-a8f0-9e97bdba94e7 admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:30.221717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712abef4-8b2a-458c-a287-2549e29491a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:30.222391 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712abef4-8b2a-458c-a287-2549e29491a8 admin admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:30.222706 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712abef4-8b2a-458c-a287-2549e29491a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:30.222977 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712abef4-8b2a-458c-a287-2549e29491a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:30.223705 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712abef4-8b2a-458c-a287-2549e29491a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:30.225343 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712abef4-8b2a-458c-a287-2549e29491a8 admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:30.242589 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 602/1182] 10.222.0.18 () {58 vars in 1121 bytes} [Mon May 2 09:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 09:01:30.242589 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712abef4-8b2a-458c-a287-2549e29491a8 admin admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:30.249911 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712abef4-8b2a-458c-a287-2549e29491a8 admin admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:30.254605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b66e7-b653-42e7-b24d-53a33629a54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:30.255490 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b66e7-b653-42e7-b24d-53a33629a54f admin admin] REQUEST_METHOD: `PUT` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:30.255768 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b66e7-b653-42e7-b24d-53a33629a54f admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:30.256061 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b66e7-b653-42e7-b24d-53a33629a54f admin admin] PATH_INFO: `/v3/projects/d9c0b09ac5594a6080714b65788b68fa/users/5a005fc657ab43ecbb4782b23184d5ae/roles/509216a314244b96b05d3fe56b0d9cd1` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:30.270727 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b66e7-b653-42e7-b24d-53a33629a54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c0b09ac5594a6080714b65788b68fa, user_id=5a005fc657ab43ecbb4782b23184d5ae, role_id=509216a314244b96b05d3fe56b0d9cd1)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:30.273536 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b66e7-b653-42e7-b24d-53a33629a54f admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:30.287572 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 581/1183] 10.222.0.18 () {60 vars in 1143 bytes} [Mon May 2 09:01:30 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:01:30.292192 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3477a9f-6640-4161-a8f0-9e97bdba94e7 admin admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:30.302507 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3477a9f-6640-4161-a8f0-9e97bdba94e7 admin admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:30.307479 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463221d9-08c7-4cdf-8d94-e8f70990f455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:30.308185 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463221d9-08c7-4cdf-8d94-e8f70990f455 admin admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:30.308480 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463221d9-08c7-4cdf-8d94-e8f70990f455 admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:30.308774 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463221d9-08c7-4cdf-8d94-e8f70990f455 admin admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:30.310154 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463221d9-08c7-4cdf-8d94-e8f70990f455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:30.311785 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463221d9-08c7-4cdf-8d94-e8f70990f455 admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:30.323596 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 582/1184] 10.222.0.18 () {58 vars in 1121 bytes} [Mon May 2 09:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 09:01:30.327777 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463221d9-08c7-4cdf-8d94-e8f70990f455 admin admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:30.340921 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463221d9-08c7-4cdf-8d94-e8f70990f455 admin admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:30.346785 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e37019-84a4-473b-830b-dc3bb8eb4bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:30.346785 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e37019-84a4-473b-830b-dc3bb8eb4bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:30.347198 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e37019-84a4-473b-830b-dc3bb8eb4bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:30.347479 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e37019-84a4-473b-830b-dc3bb8eb4bf4 admin admin] PATH_INFO: `/v3/projects/8dda78b6459c4cad90370ae20f11184f/users/7bec74e364054349a5609afe8608c071/roles/509216a314244b96b05d3fe56b0d9cd1` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:30.367398 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e37019-84a4-473b-830b-dc3bb8eb4bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dda78b6459c4cad90370ae20f11184f, user_id=7bec74e364054349a5609afe8608c071, role_id=509216a314244b96b05d3fe56b0d9cd1)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:30.371324 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e37019-84a4-473b-830b-dc3bb8eb4bf4 admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:30.380903 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 603/1185] 10.222.0.18 () {60 vars in 1482 bytes} [Mon May 2 09:01:30 2022] PUT /identity/v3/projects/d9c0b09ac5594a6080714b65788b68fa/users/5a005fc657ab43ecbb4782b23184d5ae/roles/509216a314244b96b05d3fe56b0d9cd1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:01:30.382307 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b66e7-b653-42e7-b24d-53a33629a54f admin admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:30.455662 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b66e7-b653-42e7-b24d-53a33629a54f admin admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:30.465231 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 583/1186] 10.222.0.18 () {60 vars in 1482 bytes} [Mon May 2 09:01:30 2022] PUT /identity/v3/projects/8dda78b6459c4cad90370ae20f11184f/users/7bec74e364054349a5609afe8608c071/roles/509216a314244b96b05d3fe56b0d9cd1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 09:01:30.466996 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36385a6f-4977-45fc-8c6e-8a085a22edd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:30.469008 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e37019-84a4-473b-830b-dc3bb8eb4bf4 admin admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:30.469876 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36385a6f-4977-45fc-8c6e-8a085a22edd9 admin admin] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:30.471799 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36385a6f-4977-45fc-8c6e-8a085a22edd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:30.473828 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36385a6f-4977-45fc-8c6e-8a085a22edd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:30.475258 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36385a6f-4977-45fc-8c6e-8a085a22edd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:30.477893 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36385a6f-4977-45fc-8c6e-8a085a22edd9 admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:30.492948 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 604/1187] 10.222.0.18 () {58 vars in 1121 bytes} [Mon May 2 09:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 09:01:30.497395 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36385a6f-4977-45fc-8c6e-8a085a22edd9 admin admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:30.509592 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36385a6f-4977-45fc-8c6e-8a085a22edd9 admin admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:30.554283 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e37019-84a4-473b-830b-dc3bb8eb4bf4 admin admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:30.567048 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fae45-60b5-4538-ba83-39ab8e3355ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:30.567747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fae45-60b5-4538-ba83-39ab8e3355ee admin admin] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:30.568026 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fae45-60b5-4538-ba83-39ab8e3355ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:30.568330 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fae45-60b5-4538-ba83-39ab8e3355ee admin admin] PATH_INFO: `/v3/roles` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:30.569064 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312fae45-60b5-4538-ba83-39ab8e3355ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:30.570782 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312fae45-60b5-4538-ba83-39ab8e3355ee admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:30.582730 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 584/1188] 10.222.0.18 () {58 vars in 1121 bytes} [Mon May 2 09:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 09:01:30.586592 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fae45-60b5-4538-ba83-39ab8e3355ee admin admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:30.596411 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00753776-2597-42ac-87f1-5c09079788a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:30.597717 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00753776-2597-42ac-87f1-5c09079788a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:30.598075 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00753776-2597-42ac-87f1-5c09079788a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:30.598418 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00753776-2597-42ac-87f1-5c09079788a4 admin admin] PATH_INFO: `/v3/projects/d9c0b09ac5594a6080714b65788b68fa/users/5a005fc657ab43ecbb4782b23184d5ae/roles/509216a314244b96b05d3fe56b0d9cd1` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:30.600386 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fae45-60b5-4538-ba83-39ab8e3355ee admin admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:30.601632 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00753776-2597-42ac-87f1-5c09079788a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c0b09ac5594a6080714b65788b68fa, user_id=5a005fc657ab43ecbb4782b23184d5ae, role_id=509216a314244b96b05d3fe56b0d9cd1)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:30.605127 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00753776-2597-42ac-87f1-5c09079788a4 admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:30.607054 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d04dc2-4145-407c-9ec3-2d204b841880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:30.608487 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d04dc2-4145-407c-9ec3-2d204b841880 admin admin] REQUEST_METHOD: `PUT` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:30.608822 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d04dc2-4145-407c-9ec3-2d204b841880 admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:30.609467 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d04dc2-4145-407c-9ec3-2d204b841880 admin admin] PATH_INFO: `/v3/projects/8dda78b6459c4cad90370ae20f11184f/users/7bec74e364054349a5609afe8608c071/roles/509216a314244b96b05d3fe56b0d9cd1` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:30.613342 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d04dc2-4145-407c-9ec3-2d204b841880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dda78b6459c4cad90370ae20f11184f, user_id=7bec74e364054349a5609afe8608c071, role_id=509216a314244b96b05d3fe56b0d9cd1)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:30.616919 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d04dc2-4145-407c-9ec3-2d204b841880 admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:30.625994 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 605/1189] 10.222.0.18 () {60 vars in 1482 bytes} [Mon May 2 09:01:30 2022] PUT /identity/v3/projects/d9c0b09ac5594a6080714b65788b68fa/users/5a005fc657ab43ecbb4782b23184d5ae/roles/509216a314244b96b05d3fe56b0d9cd1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 09:01:30.650346 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 585/1190] 10.222.0.18 () {60 vars in 1482 bytes} [Mon May 2 09:01:30 2022] PUT /identity/v3/projects/8dda78b6459c4cad90370ae20f11184f/users/7bec74e364054349a5609afe8608c071/roles/509216a314244b96b05d3fe56b0d9cd1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:01:37.637044 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5c58b-1598-4218-bdc9-ed4f89d9ad4a None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:37.638239 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5c58b-1598-4218-bdc9-ed4f89d9ad4a None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:37.638693 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5c58b-1598-4218-bdc9-ed4f89d9ad4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:37.681680 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-d7a5c58b-1598-4218-bdc9-ed4f89d9ad4a None None] MFA Rules not processed for user `5a005fc657ab43ecbb4782b23184d5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:01:37.683599 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-d7a5c58b-1598-4218-bdc9-ed4f89d9ad4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:37.866844 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d04dc2-4145-407c-9ec3-2d204b841880 admin admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:37.867342 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 606/1191] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 09:01:37 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:01:37.869564 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-64d04dc2-4145-407c-9ec3-2d204b841880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:37.973584 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d04dc2-4145-407c-9ec3-2d204b841880 admin admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:37.988499 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e245c0-b399-42e9-8266-ce52a36c4d16 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1bb8a2281ef49be8b2501dd399bbfe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:37.989419 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e245c0-b399-42e9-8266-ce52a36c4d16 service glance] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:37.989884 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e245c0-b399-42e9-8266-ce52a36c4d16 service glance] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:37.990320 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e245c0-b399-42e9-8266-ce52a36c4d16 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:38.095360 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e245c0-b399-42e9-8266-ce52a36c4d16 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:38.097336 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e245c0-b399-42e9-8266-ce52a36c4d16 service glance] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:38.117086 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 586/1192] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:01:37 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:01:38.318641 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26f86e-494f-4ff1-8042-a6c43fcab500 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:38.319121 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26f86e-494f-4ff1-8042-a6c43fcab500 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:38.319479 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26f86e-494f-4ff1-8042-a6c43fcab500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:38.357795 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-9d26f86e-494f-4ff1-8042-a6c43fcab500 None None] MFA Rules not processed for user `7bec74e364054349a5609afe8608c071`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:01:38.359146 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-9d26f86e-494f-4ff1-8042-a6c43fcab500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:38.441610 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 607/1193] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 09:01:38 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:01:38.455325 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e245c0-b399-42e9-8266-ce52a36c4d16 service glance] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:38.465373 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e245c0-b399-42e9-8266-ce52a36c4d16 service glance] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:38.470798 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4262753-2319-4b98-9c12-cf8b8f154cee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1bb8a2281ef49be8b2501dd399bbfe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:38.471659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4262753-2319-4b98-9c12-cf8b8f154cee service glance] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:38.471946 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4262753-2319-4b98-9c12-cf8b8f154cee service glance] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:38.472334 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4262753-2319-4b98-9c12-cf8b8f154cee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:38.540727 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4262753-2319-4b98-9c12-cf8b8f154cee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:38.542316 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4262753-2319-4b98-9c12-cf8b8f154cee service glance] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:38.553028 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 587/1194] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:01:38 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:01:47.847532 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27343a-802f-4c72-978e-51f7606ac740 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:47.849128 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27343a-802f-4c72-978e-51f7606ac740 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:47.849419 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27343a-802f-4c72-978e-51f7606ac740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:47.876243 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-da27343a-802f-4c72-978e-51f7606ac740 None None] MFA Rules not processed for user `4afb07e2227944b48853642e43f720a5`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:01:47.877448 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-da27343a-802f-4c72-978e-51f7606ac740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:47.885936 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 608/1195] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 09:01:47 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:01:48.163511 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84d412-0b31-41a1-a9bd-8252409f707e None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:48.164095 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84d412-0b31-41a1-a9bd-8252409f707e None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:48.164201 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84d412-0b31-41a1-a9bd-8252409f707e None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:48.166535 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 588/1196] 10.222.0.18 () {54 vars in 960 bytes} [Mon May 2 09:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:01:48.171803 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77c516-43e6-4028-b7f6-9e01d23411d0 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:48.172128 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77c516-43e6-4028-b7f6-9e01d23411d0 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:48.172407 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77c516-43e6-4028-b7f6-9e01d23411d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:48.195757 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-1f77c516-43e6-4028-b7f6-9e01d23411d0 None None] MFA Rules not processed for user `97308967556844019594cd0c4abc41fc`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:01:48.195757 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-1f77c516-43e6-4028-b7f6-9e01d23411d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:48.266610 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 609/1197] 10.222.0.18 () {58 vars in 1057 bytes} [Mon May 2 09:01:48 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:01:48.272093 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59797417-c6fa-4040-abc5-975d22217d66 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:48.272390 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59797417-c6fa-4040-abc5-975d22217d66 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:48.276081 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59797417-c6fa-4040-abc5-975d22217d66 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:48.276081 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 589/1198] 10.222.0.18 () {54 vars in 912 bytes} [Mon May 2 09:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:01:48.279447 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1fb5f-3936-4f47-b730-da3fdea1bf2a None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:48.279739 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1fb5f-3936-4f47-b730-da3fdea1bf2a None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:48.280015 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1fb5f-3936-4f47-b730-da3fdea1bf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:48.299155 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-f5e1fb5f-3936-4f47-b730-da3fdea1bf2a None None] MFA Rules not processed for user `97308967556844019594cd0c4abc41fc`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:01:48.300382 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-f5e1fb5f-3936-4f47-b730-da3fdea1bf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:48.309440 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 610/1199] 10.222.0.18 () {58 vars in 1009 bytes} [Mon May 2 09:01:48 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:01:48.321592 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59797417-c6fa-4040-abc5-975d22217d66 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:48.323434 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-59797417-c6fa-4040-abc5-975d22217d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:48.336576 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59797417-c6fa-4040-abc5-975d22217d66 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:48.340324 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cf7f3-88a9-4236-8a3b-3bec61906f44 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1bb8a2281ef49be8b2501dd399bbfe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:48.340967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cf7f3-88a9-4236-8a3b-3bec61906f44 service glance] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:48.341271 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cf7f3-88a9-4236-8a3b-3bec61906f44 service glance] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:48.341523 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cf7f3-88a9-4236-8a3b-3bec61906f44 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:48.354719 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cf7f3-88a9-4236-8a3b-3bec61906f44 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:48.356268 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cf7f3-88a9-4236-8a3b-3bec61906f44 service glance] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:48.367450 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 590/1200] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:01:48 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:01:48.785045 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0e6f3-cd76-4372-90ae-3489b56b2695 None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:48.786484 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0e6f3-cd76-4372-90ae-3489b56b2695 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:48.786959 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0e6f3-cd76-4372-90ae-3489b56b2695 None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:48.789509 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 611/1201] 10.222.0.18 () {54 vars in 912 bytes} [Mon May 2 09:01:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:01:48.796443 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139d0cc-be7b-4661-b624-73cd4b8d6a04 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:48.797161 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139d0cc-be7b-4661-b624-73cd4b8d6a04 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:48.797161 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139d0cc-be7b-4661-b624-73cd4b8d6a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:48.821422 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-5139d0cc-be7b-4661-b624-73cd4b8d6a04 None None] MFA Rules not processed for user `31e2b07c860d4316b35b1656f2f1c1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:01:48.823016 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-5139d0cc-be7b-4661-b624-73cd4b8d6a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:48.923628 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 591/1202] 10.222.0.18 () {58 vars in 1009 bytes} [Mon May 2 09:01:48 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:01:48.935265 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0e6f3-cd76-4372-90ae-3489b56b2695 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:48.947099 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0e6f3-cd76-4372-90ae-3489b56b2695 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:48.950864 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c562c-0e7b-4c75-ba20-412e1ba14533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:48.951543 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c562c-0e7b-4c75-ba20-412e1ba14533 service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:48.951896 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c562c-0e7b-4c75-ba20-412e1ba14533 service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:48.952308 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c562c-0e7b-4c75-ba20-412e1ba14533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:48.960037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c562c-0e7b-4c75-ba20-412e1ba14533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:48.962041 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c562c-0e7b-4c75-ba20-412e1ba14533 service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:48.970696 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 612/1203] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:01:48 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:01:49.485751 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477faec-108b-4c48-9808-01e65a865195 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:49.486797 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477faec-108b-4c48-9808-01e65a865195 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:49.488139 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477faec-108b-4c48-9808-01e65a865195 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:49.490306 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 592/1204] 10.222.0.18 () {54 vars in 960 bytes} [Mon May 2 09:01:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:01:49.497305 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca499d-5d8b-412c-be2a-a2e5025df32d None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:49.497851 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca499d-5d8b-412c-be2a-a2e5025df32d None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:49.498299 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca499d-5d8b-412c-be2a-a2e5025df32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:49.501747 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a75a46-0795-445f-8d78-e2fdcafb5d0f None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:49.506741 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a75a46-0795-445f-8d78-e2fdcafb5d0f None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:49.506741 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a75a46-0795-445f-8d78-e2fdcafb5d0f None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:49.506741 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 593/1205] 10.222.0.18 () {54 vars in 960 bytes} [Mon May 2 09:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:01:49.511617 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c6c32-d2ab-4413-a560-2cc7ec4fc375 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:49.512211 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c6c32-d2ab-4413-a560-2cc7ec4fc375 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:49.512651 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c6c32-d2ab-4413-a560-2cc7ec4fc375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:49.525065 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-01ca499d-5d8b-412c-be2a-a2e5025df32d None None] MFA Rules not processed for user `894ff70da3bb45ce858b2d34224eab93`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:01:49.526296 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-01ca499d-5d8b-412c-be2a-a2e5025df32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:49.544765 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-736c6c32-d2ab-4413-a560-2cc7ec4fc375 None None] MFA Rules not processed for user `97308967556844019594cd0c4abc41fc`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:01:49.545993 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-736c6c32-d2ab-4413-a560-2cc7ec4fc375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:49.573775 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 594/1206] 10.222.0.18 () {58 vars in 1057 bytes} [Mon May 2 09:01:49 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:01:49.580370 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7671f-2b6f-4f58-ae95-5d02e33a2f6c None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:49.580760 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7671f-2b6f-4f58-ae95-5d02e33a2f6c None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:49.581157 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7671f-2b6f-4f58-ae95-5d02e33a2f6c None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:49.583764 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 595/1207] 10.222.0.18 () {54 vars in 912 bytes} [Mon May 2 09:01:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:01:49.591650 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b0595-ee8b-45c9-b6b6-015bf656e067 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:49.592183 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b0595-ee8b-45c9-b6b6-015bf656e067 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:49.593324 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b0595-ee8b-45c9-b6b6-015bf656e067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:49.615366 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-323b0595-ee8b-45c9-b6b6-015bf656e067 None None] MFA Rules not processed for user `97308967556844019594cd0c4abc41fc`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:01:49.616614 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-323b0595-ee8b-45c9-b6b6-015bf656e067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:49.629073 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 596/1208] 10.222.0.18 () {58 vars in 1009 bytes} [Mon May 2 09:01:49 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:01:49.643792 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b0595-ee8b-45c9-b6b6-015bf656e067 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:49.644610 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 613/1209] 10.222.0.18 () {58 vars in 1057 bytes} [Mon May 2 09:01:49 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:01:49.653434 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca499d-5d8b-412c-be2a-a2e5025df32d None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:01:49.659170 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b0595-ee8b-45c9-b6b6-015bf656e067 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:49.664469 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca499d-5d8b-412c-be2a-a2e5025df32d None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:01:49.666129 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bbda7-1371-4721-b866-519e78adceba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:49.666801 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bbda7-1371-4721-b866-519e78adceba service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:49.667087 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bbda7-1371-4721-b866-519e78adceba service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:49.667363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bbda7-1371-4721-b866-519e78adceba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:49.669977 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611a475-7189-49a5-b594-ba97c80ed576 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ff70da3bb45ce858b2d34224eab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:01:49.670699 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611a475-7189-49a5-b594-ba97c80ed576 service placement] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:01:49.671054 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611a475-7189-49a5-b594-ba97c80ed576 service placement] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:01:49.671396 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611a475-7189-49a5-b594-ba97c80ed576 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:01:49.673303 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-4611a475-7189-49a5-b594-ba97c80ed576 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:01:49.681509 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bbda7-1371-4721-b866-519e78adceba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:49.682972 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bbda7-1371-4721-b866-519e78adceba service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:49.688994 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611a475-7189-49a5-b594-ba97c80ed576 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:01:49.693106 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611a475-7189-49a5-b594-ba97c80ed576 service placement] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:01:49.694684 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 597/1210] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:01:49 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:01:49.705428 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 614/1211] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:01:49 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 09:02:01.037901 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4ff6a-e1df-487d-b60b-c1c70f9c342a None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:02:01.037901 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4ff6a-e1df-487d-b60b-c1c70f9c342a None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:02:01.037901 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4ff6a-e1df-487d-b60b-c1c70f9c342a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:02:01.037901 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-b2b4ff6a-e1df-487d-b60b-c1c70f9c342a None None] MFA Rules not processed for user `31e2b07c860d4316b35b1656f2f1c1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:02:01.037901 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-b2b4ff6a-e1df-487d-b60b-c1c70f9c342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:02:01.037901 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 598/1212] 10.222.0.20 () {58 vars in 1015 bytes} [Mon May 2 09:02:00 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:02:01.038860 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611a475-7189-49a5-b594-ba97c80ed576 service placement] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:02:01.038860 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611a475-7189-49a5-b594-ba97c80ed576 service placement] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:02:01.038860 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbff0a2-b853-4d25-9bc4-8efbe480ea83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:02:01.038860 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbff0a2-b853-4d25-9bc4-8efbe480ea83 service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:02:01.039458 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbff0a2-b853-4d25-9bc4-8efbe480ea83 service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:02:01.039458 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbff0a2-b853-4d25-9bc4-8efbe480ea83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:02:01.039458 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbff0a2-b853-4d25-9bc4-8efbe480ea83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:02:01.039458 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbff0a2-b853-4d25-9bc4-8efbe480ea83 service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:02:01.039458 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 615/1213] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:02:00 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:02:02.300765 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e349a14-ca1e-4580-8bbf-65948ab30188 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:02:02.302143 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e349a14-ca1e-4580-8bbf-65948ab30188 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:02:02.302835 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e349a14-ca1e-4580-8bbf-65948ab30188 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:02:02.305432 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 599/1214] 10.222.0.18 () {54 vars in 921 bytes} [Mon May 2 09:02:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:02:02.311755 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5964c-c9d7-4d4e-a0f0-77591720f81b None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:02:02.312342 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5964c-c9d7-4d4e-a0f0-77591720f81b None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:02:02.312342 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5964c-c9d7-4d4e-a0f0-77591720f81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:02:02.335129 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-37f5964c-c9d7-4d4e-a0f0-77591720f81b None None] MFA Rules not processed for user `97308967556844019594cd0c4abc41fc`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:02:02.336639 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-37f5964c-c9d7-4d4e-a0f0-77591720f81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:02:02.346744 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 616/1215] 10.222.0.18 () {58 vars in 1018 bytes} [Mon May 2 09:02:02 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:02:02.373078 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e349a14-ca1e-4580-8bbf-65948ab30188 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:02:02.392913 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e349a14-ca1e-4580-8bbf-65948ab30188 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:02:02.398847 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6679e-3296-4497-af34-c7d947863c34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:02:02.400139 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6679e-3296-4497-af34-c7d947863c34 service nova] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:02:02.400751 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6679e-3296-4497-af34-c7d947863c34 service nova] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:02:02.401031 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6679e-3296-4497-af34-c7d947863c34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:02:02.411378 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6679e-3296-4497-af34-c7d947863c34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:02:02.413506 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6679e-3296-4497-af34-c7d947863c34 service nova] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:02:02.436909 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 600/1216] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:02:02 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:02:09.511890 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8519584-a315-4128-b218-3f17c14c6ade None None] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:02:09.512555 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8519584-a315-4128-b218-3f17c14c6ade None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:02:09.512555 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8519584-a315-4128-b218-3f17c14c6ade None None] PATH_INFO: `/` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:02:09.513851 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 617/1217] 10.222.0.18 () {54 vars in 921 bytes} [Mon May 2 09:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:02:09.523188 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e55e9-82bc-41b5-ae8b-308758dd06f4 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:02:09.524236 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e55e9-82bc-41b5-ae8b-308758dd06f4 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:02:09.524519 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e55e9-82bc-41b5-ae8b-308758dd06f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:02:09.543555 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-647e55e9-82bc-41b5-ae8b-308758dd06f4 None None] MFA Rules not processed for user `97308967556844019594cd0c4abc41fc`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:02:09.544872 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-647e55e9-82bc-41b5-ae8b-308758dd06f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:02:09.554252 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 601/1218] 10.222.0.18 () {58 vars in 1018 bytes} [Mon May 2 09:02:09 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:02:09.567975 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8519584-a315-4128-b218-3f17c14c6ade None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:02:09.582626 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8519584-a315-4128-b218-3f17c14c6ade None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:02:09.590720 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228d1a4-fc13-47c5-841d-9d86cbb7fdb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:02:09.591542 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228d1a4-fc13-47c5-841d-9d86cbb7fdb9 service nova] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:02:09.591830 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228d1a4-fc13-47c5-841d-9d86cbb7fdb9 service nova] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:02:09.592136 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228d1a4-fc13-47c5-841d-9d86cbb7fdb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:02:09.603263 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228d1a4-fc13-47c5-841d-9d86cbb7fdb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:02:09.606426 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228d1a4-fc13-47c5-841d-9d86cbb7fdb9 service nova] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:02:09.619906 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 618/1219] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:02:09 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:02:22.839011 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e55e9-82bc-41b5-ae8b-308758dd06f4 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:02:22.848892 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e55e9-82bc-41b5-ae8b-308758dd06f4 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:02:22.853823 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca00d6-028e-4b7d-8e32-a19463df4e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:02:22.853823 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca00d6-028e-4b7d-8e32-a19463df4e9e service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:02:22.853823 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca00d6-028e-4b7d-8e32-a19463df4e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:02:22.853823 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca00d6-028e-4b7d-8e32-a19463df4e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:02:22.863087 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca00d6-028e-4b7d-8e32-a19463df4e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:02:22.864578 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca00d6-028e-4b7d-8e32-a19463df4e9e service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:02:22.874455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 602/1220] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:02:22 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:03:29.785186 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe92e9b-2328-4e1e-b0ab-cd60c0a7c0a1 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:03:29.785668 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe92e9b-2328-4e1e-b0ab-cd60c0a7c0a1 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:03:29.785750 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe92e9b-2328-4e1e-b0ab-cd60c0a7c0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:03:29.811718 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-ebe92e9b-2328-4e1e-b0ab-cd60c0a7c0a1 None None] MFA Rules not processed for user `f638d0a6ff5046dcbcef64c8c58d2517`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:03:29.812923 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-ebe92e9b-2328-4e1e-b0ab-cd60c0a7c0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:03:29.836242 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 619/1221] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 09:03:29 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:03:30.139786 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0bb20-0d43-4585-892f-d3f5d0c8c1e3 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:03:30.140399 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0bb20-0d43-4585-892f-d3f5d0c8c1e3 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:03:30.140399 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0bb20-0d43-4585-892f-d3f5d0c8c1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:03:30.186124 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-63b0bb20-0d43-4585-892f-d3f5d0c8c1e3 None None] MFA Rules not processed for user `31e2b07c860d4316b35b1656f2f1c1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:03:30.187271 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-63b0bb20-0d43-4585-892f-d3f5d0c8c1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:03:30.209327 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 603/1222] 10.222.0.18 () {58 vars in 1009 bytes} [Mon May 2 09:03:30 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:03:30.220585 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe92e9b-2328-4e1e-b0ab-cd60c0a7c0a1 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:03:30.229777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe92e9b-2328-4e1e-b0ab-cd60c0a7c0a1 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:03:30.233408 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a0dca-5247-4f16-b7ab-712a6e088e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:03:30.234039 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a0dca-5247-4f16-b7ab-712a6e088e0d service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:03:30.234322 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a0dca-5247-4f16-b7ab-712a6e088e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:03:30.234608 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a0dca-5247-4f16-b7ab-712a6e088e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:03:30.241965 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a0dca-5247-4f16-b7ab-712a6e088e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:03:30.243392 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a0dca-5247-4f16-b7ab-712a6e088e0d service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:03:30.250989 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 620/1223] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:03:30 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:03:33.670967 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db76c31-4050-40f5-a96a-14841a6134a5 None None] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:03:33.671465 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db76c31-4050-40f5-a96a-14841a6134a5 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:03:33.671534 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db76c31-4050-40f5-a96a-14841a6134a5 None None] PATH_INFO: `/` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:03:33.673631 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 604/1224] 10.222.0.18 () {54 vars in 921 bytes} [Mon May 2 09:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:03:33.680133 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ffed1-2f46-4678-9eec-6f34130ac163 None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:03:33.680605 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ffed1-2f46-4678-9eec-6f34130ac163 None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:03:33.680681 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ffed1-2f46-4678-9eec-6f34130ac163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:03:33.701942 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-1c2ffed1-2f46-4678-9eec-6f34130ac163 None None] MFA Rules not processed for user `97308967556844019594cd0c4abc41fc`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:03:33.703922 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-1c2ffed1-2f46-4678-9eec-6f34130ac163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:03:33.725777 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 621/1225] 10.222.0.18 () {58 vars in 1018 bytes} [Mon May 2 09:03:33 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:03:33.737659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db76c31-4050-40f5-a96a-14841a6134a5 None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:03:33.753008 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db76c31-4050-40f5-a96a-14841a6134a5 None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:03:33.759731 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b236b3-d429-487b-94b6-c49e82a5788e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:03:33.761167 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b236b3-d429-487b-94b6-c49e82a5788e service nova] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:03:33.761593 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b236b3-d429-487b-94b6-c49e82a5788e service nova] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:03:33.762007 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b236b3-d429-487b-94b6-c49e82a5788e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:03:33.789485 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b236b3-d429-487b-94b6-c49e82a5788e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:03:33.791823 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b236b3-d429-487b-94b6-c49e82a5788e service nova] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:03:33.805182 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 605/1226] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:03:33 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:03:54.746206 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ffed1-2f46-4678-9eec-6f34130ac163 None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:03:54.829152 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ffed1-2f46-4678-9eec-6f34130ac163 None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:03:54.834326 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22275c-060c-4f6f-8707-ce42de234dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:03:54.835981 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22275c-060c-4f6f-8707-ce42de234dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:03:54.835981 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22275c-060c-4f6f-8707-ce42de234dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:03:54.835981 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22275c-060c-4f6f-8707-ce42de234dfd admin admin] PATH_INFO: `/v3/users/4afb07e2227944b48853642e43f720a5` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:03:54.836976 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22275c-060c-4f6f-8707-ce42de234dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4afb07e2227944b48853642e43f720a5)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:03:54.838945 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22275c-060c-4f6f-8707-ce42de234dfd admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:03:55.002171 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-4f22275c-060c-4f6f-8707-ce42de234dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4afb07e2227944b48853642e43f720a5'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:55.143078 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-4f22275c-060c-4f6f-8707-ce42de234dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4afb07e2227944b48853642e43f720a5'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:55.143697 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-4f22275c-060c-4f6f-8707-ce42de234dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4afb07e2227944b48853642e43f720a5'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:55.151005 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-4f22275c-060c-4f6f-8707-ce42de234dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4afb07e2227944b48853642e43f720a5'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:55.162568 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-4f22275c-060c-4f6f-8707-ce42de234dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4afb07e2227944b48853642e43f720a5'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:55.168610 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 622/1227] 10.222.0.18 () {58 vars in 1223 bytes} [Mon May 2 09:03:54 2022] DELETE /identity/v3/users/4afb07e2227944b48853642e43f720a5 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:03:55.447304 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b236b3-d429-487b-94b6-c49e82a5788e service nova] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:03:55.458894 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b236b3-d429-487b-94b6-c49e82a5788e service nova] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:03:55.516449 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c368746-f295-421d-a738-f11060073265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:03:55.517437 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c368746-f295-421d-a738-f11060073265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:03:55.517724 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c368746-f295-421d-a738-f11060073265 admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:03:55.517996 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c368746-f295-421d-a738-f11060073265 admin admin] PATH_INFO: `/v3/projects/ad3bd761ff9b4a7fb2e24de76e6b3fe0` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:03:55.519245 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c368746-f295-421d-a738-f11060073265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad3bd761ff9b4a7fb2e24de76e6b3fe0)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:03:55.521215 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c368746-f295-421d-a738-f11060073265 admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:03:55.622516 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-7c368746-f295-421d-a738-f11060073265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad3bd761ff9b4a7fb2e24de76e6b3fe0', 'request_id': 'req-7c368746-f295-421d-a738-f11060073265'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:55.702821 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-7c368746-f295-421d-a738-f11060073265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad3bd761ff9b4a7fb2e24de76e6b3fe0', 'request_id': 'req-7c368746-f295-421d-a738-f11060073265'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:55.710591 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-7c368746-f295-421d-a738-f11060073265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad3bd761ff9b4a7fb2e24de76e6b3fe0', 'request_id': 'req-7c368746-f295-421d-a738-f11060073265'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:55.734580 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-7c368746-f295-421d-a738-f11060073265 admin admin] The token cache is being invalidate because project ad3bd761ff9b4a7fb2e24de76e6b3fe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 09:03:55.735003 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-7c368746-f295-421d-a738-f11060073265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:55.735622 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-7c368746-f295-421d-a738-f11060073265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:55.737177 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 606/1228] 10.222.0.18 () {58 vars in 1232 bytes} [Mon May 2 09:03:55 2022] DELETE /identity/v3/projects/ad3bd761ff9b4a7fb2e24de76e6b3fe0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 09:03:55.741414 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22275c-060c-4f6f-8707-ce42de234dfd admin admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:03:55.742783 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-4f22275c-060c-4f6f-8707-ce42de234dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:03:55.755674 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22275c-060c-4f6f-8707-ce42de234dfd admin admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:03:55.811692 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df820c9c-9e9d-419d-9cd0-ed765bdec117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:03:55.812596 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df820c9c-9e9d-419d-9cd0-ed765bdec117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:03:55.812879 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df820c9c-9e9d-419d-9cd0-ed765bdec117 admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:03:55.813156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df820c9c-9e9d-419d-9cd0-ed765bdec117 admin admin] PATH_INFO: `/v3/users/5a005fc657ab43ecbb4782b23184d5ae` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:03:55.814326 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df820c9c-9e9d-419d-9cd0-ed765bdec117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a005fc657ab43ecbb4782b23184d5ae)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:03:55.816280 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df820c9c-9e9d-419d-9cd0-ed765bdec117 admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:03:55.995796 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-df820c9c-9e9d-419d-9cd0-ed765bdec117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a005fc657ab43ecbb4782b23184d5ae'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:56.057146 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-df820c9c-9e9d-419d-9cd0-ed765bdec117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a005fc657ab43ecbb4782b23184d5ae'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:56.057774 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-df820c9c-9e9d-419d-9cd0-ed765bdec117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a005fc657ab43ecbb4782b23184d5ae'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:56.066683 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-df820c9c-9e9d-419d-9cd0-ed765bdec117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a005fc657ab43ecbb4782b23184d5ae'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:56.078704 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-df820c9c-9e9d-419d-9cd0-ed765bdec117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a005fc657ab43ecbb4782b23184d5ae'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:56.085323 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 623/1229] 10.222.0.18 () {58 vars in 1223 bytes} [Mon May 2 09:03:55 2022] DELETE /identity/v3/users/5a005fc657ab43ecbb4782b23184d5ae => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:03:56.310165 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c368746-f295-421d-a738-f11060073265 admin admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:03:56.311607 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-7c368746-f295-421d-a738-f11060073265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:03:56.325172 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c368746-f295-421d-a738-f11060073265 admin admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:03:56.381866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1fb00-5ed0-4fca-b64a-e294144edeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:03:56.382732 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1fb00-5ed0-4fca-b64a-e294144edeef admin admin] REQUEST_METHOD: `DELETE` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:03:56.383015 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1fb00-5ed0-4fca-b64a-e294144edeef admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:03:56.383288 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1fb00-5ed0-4fca-b64a-e294144edeef admin admin] PATH_INFO: `/v3/projects/d9c0b09ac5594a6080714b65788b68fa` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:03:56.384534 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1fb00-5ed0-4fca-b64a-e294144edeef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9c0b09ac5594a6080714b65788b68fa)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:03:56.386684 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1fb00-5ed0-4fca-b64a-e294144edeef admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:03:56.491343 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-aab1fb00-5ed0-4fca-b64a-e294144edeef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9c0b09ac5594a6080714b65788b68fa', 'request_id': 'req-aab1fb00-5ed0-4fca-b64a-e294144edeef'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:56.565759 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-aab1fb00-5ed0-4fca-b64a-e294144edeef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9c0b09ac5594a6080714b65788b68fa', 'request_id': 'req-aab1fb00-5ed0-4fca-b64a-e294144edeef'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:56.573891 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-aab1fb00-5ed0-4fca-b64a-e294144edeef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9c0b09ac5594a6080714b65788b68fa', 'request_id': 'req-aab1fb00-5ed0-4fca-b64a-e294144edeef'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:56.592545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-aab1fb00-5ed0-4fca-b64a-e294144edeef admin admin] The token cache is being invalidate because project d9c0b09ac5594a6080714b65788b68fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 09:03:56.592545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-aab1fb00-5ed0-4fca-b64a-e294144edeef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:56.592545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-aab1fb00-5ed0-4fca-b64a-e294144edeef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:03:56.592545 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 607/1230] 10.222.0.18 () {58 vars in 1232 bytes} [Mon May 2 09:03:56 2022] DELETE /identity/v3/projects/d9c0b09ac5594a6080714b65788b68fa => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:04:06.823406 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33616d85-7b05-4f51-a0c1-a9d5097849fb None None] REQUEST_METHOD: `POST` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:04:06.823884 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33616d85-7b05-4f51-a0c1-a9d5097849fb None None] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:04:06.823972 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33616d85-7b05-4f51-a0c1-a9d5097849fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:04:06.840865 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.auth.core [None req-33616d85-7b05-4f51-a0c1-a9d5097849fb None None] MFA Rules not processed for user `f638d0a6ff5046dcbcef64c8c58d2517`. Rule list: `[]` (Enabled: `True`). {{(pid=93340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:04:06.842042 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-33616d85-7b05-4f51-a0c1-a9d5097849fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:04:06.897874 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 624/1231] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 09:04:06 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:04:24.122157 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcf0df-cdde-4993-a3ea-31491640e7c2 None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:04:24.122598 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcf0df-cdde-4993-a3ea-31491640e7c2 None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:04:24.122715 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcf0df-cdde-4993-a3ea-31491640e7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:04:24.140000 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-bdfcf0df-cdde-4993-a3ea-31491640e7c2 None None] MFA Rules not processed for user `f638d0a6ff5046dcbcef64c8c58d2517`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:04:24.141217 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-bdfcf0df-cdde-4993-a3ea-31491640e7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:04:24.148531 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 608/1232] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 09:04:24 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:04:43.963018 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33616d85-7b05-4f51-a0c1-a9d5097849fb None None] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:04:43.964507 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-33616d85-7b05-4f51-a0c1-a9d5097849fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:04:44.059770 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33616d85-7b05-4f51-a0c1-a9d5097849fb None None] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:04:44.066505 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a6813-6c47-4299-9d68-be5c5c002373 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ff70da3bb45ce858b2d34224eab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:04:44.067143 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a6813-6c47-4299-9d68-be5c5c002373 service placement] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:04:44.067423 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a6813-6c47-4299-9d68-be5c5c002373 service placement] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:04:44.067696 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a6813-6c47-4299-9d68-be5c5c002373 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:04:44.069447 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-a46a6813-6c47-4299-9d68-be5c5c002373 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:04:44.081732 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a6813-6c47-4299-9d68-be5c5c002373 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:04:44.083303 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a6813-6c47-4299-9d68-be5c5c002373 service placement] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:04:44.092852 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 625/1233] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:04:43 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:05:41.679659 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1e9b3-af37-4157-88eb-a4ecb933e8ed None None] REQUEST_METHOD: `POST` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:05:41.680171 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1e9b3-af37-4157-88eb-a4ecb933e8ed None None] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:05:41.680264 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1e9b3-af37-4157-88eb-a4ecb933e8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:05:41.697826 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.auth.core [None req-72e1e9b3-af37-4157-88eb-a4ecb933e8ed None None] MFA Rules not processed for user `f638d0a6ff5046dcbcef64c8c58d2517`. Rule list: `[]` (Enabled: `True`). {{(pid=93341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:05:41.699041 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-72e1e9b3-af37-4157-88eb-a4ecb933e8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:05:41.705773 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 609/1234] 10.222.0.18 () {58 vars in 957 bytes} [Mon May 2 09:05:41 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 09:05:56.943424 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a6813-6c47-4299-9d68-be5c5c002373 service placement] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:05:56.944882 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-a46a6813-6c47-4299-9d68-be5c5c002373 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:05:56.997771 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a6813-6c47-4299-9d68-be5c5c002373 service placement] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:05:57.001363 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bac400-3907-435c-ba2f-10b848ac166f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:05:57.002566 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bac400-3907-435c-ba2f-10b848ac166f service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:05:57.002852 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bac400-3907-435c-ba2f-10b848ac166f service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:05:57.003125 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bac400-3907-435c-ba2f-10b848ac166f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:05:57.004888 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-62bac400-3907-435c-ba2f-10b848ac166f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:05:57.063489 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bac400-3907-435c-ba2f-10b848ac166f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:05:57.067248 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bac400-3907-435c-ba2f-10b848ac166f service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:05:57.077076 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 626/1235] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:05:56 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:07:49.307779 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1e9b3-af37-4157-88eb-a4ecb933e8ed None None] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:07:49.310379 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-72e1e9b3-af37-4157-88eb-a4ecb933e8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:07:49.325315 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1e9b3-af37-4157-88eb-a4ecb933e8ed None None] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:07:49.328928 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ff704-82dd-458e-a7d2-8f1b819831e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:07:49.329570 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ff704-82dd-458e-a7d2-8f1b819831e8 service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:07:49.329847 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ff704-82dd-458e-a7d2-8f1b819831e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:07:49.330114 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ff704-82dd-458e-a7d2-8f1b819831e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:07:49.331865 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-ff5ff704-82dd-458e-a7d2-8f1b819831e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:07:49.341121 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ff704-82dd-458e-a7d2-8f1b819831e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:07:49.342544 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ff704-82dd-458e-a7d2-8f1b819831e8 service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:07:49.350219 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 610/1236] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:07:49 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:09:32.877059 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bac400-3907-435c-ba2f-10b848ac166f service neutron] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:09:32.878525 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-62bac400-3907-435c-ba2f-10b848ac166f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:09:32.964369 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bac400-3907-435c-ba2f-10b848ac166f service neutron] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:09:32.969269 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c3a54-23e1-4549-a90d-2daa9f9e046b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:09:32.971130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c3a54-23e1-4549-a90d-2daa9f9e046b service nova] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:09:32.971130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c3a54-23e1-4549-a90d-2daa9f9e046b service nova] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:09:32.971130 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c3a54-23e1-4549-a90d-2daa9f9e046b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:09:32.972366 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-a25c3a54-23e1-4549-a90d-2daa9f9e046b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:09:32.982978 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c3a54-23e1-4549-a90d-2daa9f9e046b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:09:32.984570 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c3a54-23e1-4549-a90d-2daa9f9e046b service nova] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:09:32.993503 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 627/1237] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:09:32 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:09:34.023700 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ff704-82dd-458e-a7d2-8f1b819831e8 service neutron] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:09:34.036344 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ff704-82dd-458e-a7d2-8f1b819831e8 service neutron] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:09:34.042711 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9927fb-5ec4-4e8b-a229-45d790e19d21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:09:34.043370 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9927fb-5ec4-4e8b-a229-45d790e19d21 service nova] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:09:34.043658 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9927fb-5ec4-4e8b-a229-45d790e19d21 service nova] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:09:34.043929 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9927fb-5ec4-4e8b-a229-45d790e19d21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:09:34.045912 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-ac9927fb-5ec4-4e8b-a229-45d790e19d21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:09:34.058812 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9927fb-5ec4-4e8b-a229-45d790e19d21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:09:34.060465 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9927fb-5ec4-4e8b-a229-45d790e19d21 service nova] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:09:34.070898 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 611/1238] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:09:34 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:09:34.479868 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c3a54-23e1-4549-a90d-2daa9f9e046b service nova] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:09:34.490456 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c3a54-23e1-4549-a90d-2daa9f9e046b service nova] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:09:34.494329 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace14917-fdd8-46c1-9748-cfc328877517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:09:34.494993 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace14917-fdd8-46c1-9748-cfc328877517 service neutron] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:09:34.495293 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace14917-fdd8-46c1-9748-cfc328877517 service neutron] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:09:34.495926 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace14917-fdd8-46c1-9748-cfc328877517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:09:34.497836 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-ace14917-fdd8-46c1-9748-cfc328877517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:09:34.511500 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace14917-fdd8-46c1-9748-cfc328877517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:09:34.513011 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace14917-fdd8-46c1-9748-cfc328877517 service neutron] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:09:34.525277 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 628/1239] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:09:34 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:09:35.720275 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9927fb-5ec4-4e8b-a229-45d790e19d21 service nova] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:09:35.730220 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9927fb-5ec4-4e8b-a229-45d790e19d21 service nova] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:09:35.733790 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dc7f7-d36c-4ea1-b72c-e81cdac6cd9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:09:35.734425 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dc7f7-d36c-4ea1-b72c-e81cdac6cd9a service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:09:35.734709 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dc7f7-d36c-4ea1-b72c-e81cdac6cd9a service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:09:35.734985 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dc7f7-d36c-4ea1-b72c-e81cdac6cd9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:09:35.736764 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-5f2dc7f7-d36c-4ea1-b72c-e81cdac6cd9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:09:35.748994 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dc7f7-d36c-4ea1-b72c-e81cdac6cd9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:09:35.750371 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dc7f7-d36c-4ea1-b72c-e81cdac6cd9a service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:09:35.760621 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 612/1240] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:09:35 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:09:36.592037 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace14917-fdd8-46c1-9748-cfc328877517 service neutron] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:09:36.602397 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace14917-fdd8-46c1-9748-cfc328877517 service neutron] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:09:36.607372 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88951817-f573-466c-88f0-687ef5497b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97308967556844019594cd0c4abc41fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:09:36.611157 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88951817-f573-466c-88f0-687ef5497b18 service nova] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:09:36.611157 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88951817-f573-466c-88f0-687ef5497b18 service nova] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:09:36.611157 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88951817-f573-466c-88f0-687ef5497b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:09:36.611157 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-88951817-f573-466c-88f0-687ef5497b18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:09:36.622160 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88951817-f573-466c-88f0-687ef5497b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:09:36.623763 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88951817-f573-466c-88f0-687ef5497b18 service nova] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:09:36.634202 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 629/1241] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:09:36 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:09:44.873866 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dc7f7-d36c-4ea1-b72c-e81cdac6cd9a service neutron] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:09:44.882190 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dc7f7-d36c-4ea1-b72c-e81cdac6cd9a service neutron] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:09:44.886607 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1a5f1-700d-45e8-ab49-b63fafc7774c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e2b07c860d4316b35b1656f2f1c1aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:09:44.889942 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1a5f1-700d-45e8-ab49-b63fafc7774c service neutron] REQUEST_METHOD: `GET` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:09:44.889942 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1a5f1-700d-45e8-ab49-b63fafc7774c service neutron] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:09:44.889942 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1a5f1-700d-45e8-ab49-b63fafc7774c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:09:44.889942 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-06f1a5f1-700d-45e8-ab49-b63fafc7774c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:09:44.948931 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1a5f1-700d-45e8-ab49-b63fafc7774c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:09:44.950351 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1a5f1-700d-45e8-ab49-b63fafc7774c service neutron] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:09:44.959446 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 613/1242] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:09:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:09:51.942059 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88951817-f573-466c-88f0-687ef5497b18 service nova] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:09:51.963920 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88951817-f573-466c-88f0-687ef5497b18 service nova] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:09:51.969368 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42daaa-f941-457c-9bb5-0d246aaf7891 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '894ff70da3bb45ce858b2d34224eab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758931ec3ed54a1eadf1b9a463fbb241', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:09:51.970025 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42daaa-f941-457c-9bb5-0d246aaf7891 service placement] REQUEST_METHOD: `GET` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:09:51.970338 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42daaa-f941-457c-9bb5-0d246aaf7891 service placement] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:09:51.970613 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42daaa-f941-457c-9bb5-0d246aaf7891 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:09:51.980584 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42daaa-f941-457c-9bb5-0d246aaf7891 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:09:51.982156 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42daaa-f941-457c-9bb5-0d246aaf7891 service placement] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:09:51.991947 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 630/1243] 10.222.0.18 () {60 vars in 1365 bytes} [Mon May 2 09:09:51 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 09:09:52.200392 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1a5f1-700d-45e8-ab49-b63fafc7774c service neutron] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:09:52.202484 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-06f1a5f1-700d-45e8-ab49-b63fafc7774c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:09:52.216193 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1a5f1-700d-45e8-ab49-b63fafc7774c service neutron] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:09:52.220455 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a7d66-5aa9-44d3-9c43-17ce8b8b6fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:09:52.221322 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a7d66-5aa9-44d3-9c43-17ce8b8b6fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:09:52.221603 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a7d66-5aa9-44d3-9c43-17ce8b8b6fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:09:52.221871 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a7d66-5aa9-44d3-9c43-17ce8b8b6fe4 admin admin] PATH_INFO: `/v3/users/f638d0a6ff5046dcbcef64c8c58d2517` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:09:52.223141 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a7d66-5aa9-44d3-9c43-17ce8b8b6fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f638d0a6ff5046dcbcef64c8c58d2517)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:09:52.224190 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: WARNING py.warnings [None req-a04a7d66-5aa9-44d3-9c43-17ce8b8b6fe4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 09:09:52.224190 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: warnings.warn(msg) May 02 09:09:52.224190 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: May 02 09:09:52.225382 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a7d66-5aa9-44d3-9c43-17ce8b8b6fe4 admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:09:52.433464 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-a04a7d66-5aa9-44d3-9c43-17ce8b8b6fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f638d0a6ff5046dcbcef64c8c58d2517'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:52.492292 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-a04a7d66-5aa9-44d3-9c43-17ce8b8b6fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f638d0a6ff5046dcbcef64c8c58d2517'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:52.492932 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-a04a7d66-5aa9-44d3-9c43-17ce8b8b6fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f638d0a6ff5046dcbcef64c8c58d2517'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:52.503435 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-a04a7d66-5aa9-44d3-9c43-17ce8b8b6fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f638d0a6ff5046dcbcef64c8c58d2517'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:52.521453 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-a04a7d66-5aa9-44d3-9c43-17ce8b8b6fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f638d0a6ff5046dcbcef64c8c58d2517'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:52.527799 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 614/1244] 10.222.0.18 () {58 vars in 1223 bytes} [Mon May 2 09:09:52 2022] DELETE /identity/v3/users/f638d0a6ff5046dcbcef64c8c58d2517 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:09:52.739348 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42daaa-f941-457c-9bb5-0d246aaf7891 service placement] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:09:52.750402 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42daaa-f941-457c-9bb5-0d246aaf7891 service placement] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:09:52.814213 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:09:52.815071 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:09:52.815354 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:09:52.815631 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a admin admin] PATH_INFO: `/v3/projects/8147b7f51f8045e79f01167e27a4005d` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:09:52.816860 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8147b7f51f8045e79f01167e27a4005d)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:09:52.817882 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: WARNING py.warnings [None req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 09:09:52.817882 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: warnings.warn(msg) May 02 09:09:52.817882 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: May 02 09:09:52.819054 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:09:52.924136 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8147b7f51f8045e79f01167e27a4005d', 'request_id': 'req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:52.937697 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8147b7f51f8045e79f01167e27a4005d', 'request_id': 'req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:52.943622 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8147b7f51f8045e79f01167e27a4005d', 'request_id': 'req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:53.004092 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a admin admin] The token cache is being invalidate because project 8147b7f51f8045e79f01167e27a4005d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 09:09:53.004321 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:53.004938 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:53.006478 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 631/1245] 10.222.0.18 () {58 vars in 1232 bytes} [Mon May 2 09:09:52 2022] DELETE /identity/v3/projects/8147b7f51f8045e79f01167e27a4005d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:09:53.011741 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a7d66-5aa9-44d3-9c43-17ce8b8b6fe4 admin admin] Authenticating user token {{(pid=93341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:09:53.013208 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.fernet_utils [None req-a04a7d66-5aa9-44d3-9c43-17ce8b8b6fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:09:53.026929 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a7d66-5aa9-44d3-9c43-17ce8b8b6fe4 admin admin] Validating token access rules against request {{(pid=93341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:09:53.082363 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b8832-1f9f-4fab-b4fa-95d5d464f6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:09:53.083263 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b8832-1f9f-4fab-b4fa-95d5d464f6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:09:53.083550 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b8832-1f9f-4fab-b4fa-95d5d464f6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:09:53.083818 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b8832-1f9f-4fab-b4fa-95d5d464f6a6 admin admin] PATH_INFO: `/v3/users/7bec74e364054349a5609afe8608c071` {{(pid=93341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:09:53.085021 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b8832-1f9f-4fab-b4fa-95d5d464f6a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bec74e364054349a5609afe8608c071)` {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:09:53.086989 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b8832-1f9f-4fab-b4fa-95d5d464f6a6 admin admin] RBAC: Authorization granted {{(pid=93341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:09:53.264185 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-f14b8832-1f9f-4fab-b4fa-95d5d464f6a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bec74e364054349a5609afe8608c071'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:53.330499 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-f14b8832-1f9f-4fab-b4fa-95d5d464f6a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bec74e364054349a5609afe8608c071'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:53.331120 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-f14b8832-1f9f-4fab-b4fa-95d5d464f6a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bec74e364054349a5609afe8608c071'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:53.338384 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-f14b8832-1f9f-4fab-b4fa-95d5d464f6a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bec74e364054349a5609afe8608c071'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:53.351094 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: DEBUG keystone.notifications [None req-f14b8832-1f9f-4fab-b4fa-95d5d464f6a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bec74e364054349a5609afe8608c071'} {{(pid=93341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:53.357654 dv-osbrick-master-4-ceph devstack@keystone.service[93341]: [pid: 93341|app: 0|req: 615/1246] 10.222.0.18 () {58 vars in 1223 bytes} [Mon May 2 09:09:53 2022] DELETE /identity/v3/users/7bec74e364054349a5609afe8608c071 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:09:53.590485 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a admin admin] Authenticating user token {{(pid=93340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:09:53.592001 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.fernet_utils [None req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:09:53.605434 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c06524-95b2-4122-bf7a-3b8b41f2ef1a admin admin] Validating token access rules against request {{(pid=93340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:09:53.660948 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a12a2f-15a5-4769-8e87-fe46691edb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d461fea7474f0cabc39359a0a27117', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '551938bc45944ca2b1d6b90c735fdb29', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:09:53.661809 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a12a2f-15a5-4769-8e87-fe46691edb7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:09:53.662086 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a12a2f-15a5-4769-8e87-fe46691edb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:09:53.662383 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a12a2f-15a5-4769-8e87-fe46691edb7c admin admin] PATH_INFO: `/v3/projects/8dda78b6459c4cad90370ae20f11184f` {{(pid=93340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:09:53.663554 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a12a2f-15a5-4769-8e87-fe46691edb7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dda78b6459c4cad90370ae20f11184f)` {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:09:53.666390 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a12a2f-15a5-4769-8e87-fe46691edb7c admin admin] RBAC: Authorization granted {{(pid=93340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:09:53.788895 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-29a12a2f-15a5-4769-8e87-fe46691edb7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dda78b6459c4cad90370ae20f11184f', 'request_id': 'req-29a12a2f-15a5-4769-8e87-fe46691edb7c'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:53.795863 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-29a12a2f-15a5-4769-8e87-fe46691edb7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dda78b6459c4cad90370ae20f11184f', 'request_id': 'req-29a12a2f-15a5-4769-8e87-fe46691edb7c'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:53.801193 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-29a12a2f-15a5-4769-8e87-fe46691edb7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dda78b6459c4cad90370ae20f11184f', 'request_id': 'req-29a12a2f-15a5-4769-8e87-fe46691edb7c'} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:53.886509 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-29a12a2f-15a5-4769-8e87-fe46691edb7c admin admin] The token cache is being invalidate because project 8dda78b6459c4cad90370ae20f11184f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 09:09:53.886745 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-29a12a2f-15a5-4769-8e87-fe46691edb7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:53.887414 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: DEBUG keystone.notifications [None req-29a12a2f-15a5-4769-8e87-fe46691edb7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 09:09:53.889055 dv-osbrick-master-4-ceph devstack@keystone.service[93340]: [pid: 93340|app: 0|req: 632/1247] 10.222.0.18 () {58 vars in 1232 bytes} [Mon May 2 09:09:53 2022] DELETE /identity/v3/projects/8dda78b6459c4cad90370ae20f11184f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0)